User terminal apparatus and management method of home network thereof

ABSTRACT

An example user terminal apparatus includes communication circuitry configured to be connected to a home network comprising a plurality of devices; a display configured to display a UI screen for managing the home network; a sensor configured to sense a user manipulation of the UI screen; and processing circuitry configured to change the UI screen displayed on the display according to the user manipulation. The UI screen is one of a plurality of service pages that are changeable according to a user manipulation in a first direction, the plurality of service pages being pages for respectively providing different home network management services. At least one of the plurality of service pages comprises an area that is displayable on the display according to a user manipulation in a second direction.

CROSS-REFERENCE TO RELATED APPLICATION

This application is the national stage of PCT application no.PCT/KR2014/005385, filed Jun. 18, 2014, which designated the UnitedStates, and which claims the benefit of U.S. provisional applicationSer. No. 61/836,251, filed on Jun. 18, 2013, and KR 10-2014-0074580,filed on Jun. 18, 2014. The contents of each of these applications areincorporated herein in their entirety.

TECHNICAL FIELD

The present application generally describes a user terminal apparatusand a management method of a home network thereof, and moreparticularly, a user terminal apparatus that provides various userinterface (UI) screens for managing a home network and a managementmethod of a home network thereof.

BACKGROUND AND SUMMARY

With the development of computer technologies, communicationtechnologies, and home electronics technologies, a network managementservice for managing a home network to which apparatuses and systems ina home are connected has taken center stage as a future-orientedtechnology.

All types of information electronic appliances that are connected to oneanother through a home network in a home may transmit data to oneanother and communicate with various types of user terminal apparatuses.For example, a user may control all types of electronic appliances thatare connected to one another through a home network in a home regardlessof time and place, by using a UI installed in a user terminal apparatussuch as a portable phone, a mobile phone, a smart phone or the like.

However, since ubiquitous service eXchanges (UXs), which are providedaccording to different types of businesses such as a manufacturer, acommunication company, etc., are different, it is still difficult toprovide a home network management service. For example, whenever adevice is newly added to a home network, the user has no choice but toadapt to a new UI screen design or have the discomfort of a fixed UIscreen that may not satisfy various tastes of the user.

Also, various services, such as controls, methods, energy management,and the like of home appliances, are provided in a home network system.However, it can be difficult for the user to check, in one view, variousfunctions provided from various services through only an existingservice UI screen.

The present application describes a user terminal apparatus thatprovides various user interface (UI) screens for managing a home networkand a method of managing a home network thereof.

According to a non-limiting aspect of the technology described herein,there is provided a user terminal apparatus including: a communicationunit configured to be connected to a home network comprising a pluralityof devices; a display unit configured to display a UI screen formanaging the home network; a sensing unit configured to sense a usermanipulation of the UI screen; and a control unit configured to changethe UI screen displayed on the display unit according to the usermanipulation. The UI screen may be one of a plurality of service pagesthat are changeable according to a user manipulation in a firstdirection, and the plurality of service pages may be pages forrespectively providing different home network management services, andat least one of the plurality of service pages may include an area thatis displayable on the display unit according to a user manipulation in asecond direction.

In response to one of the plurality of service pages being selected, thecontrol unit may display a function area page subordinate to the servicepage on the display unit.

The first direction may be a horizontal direction, the second directionmay be a vertical direction, and the control unit may sequentiallydisplay the plurality of service pages page by page in response to aflick or drag manipulation being input in the horizontal direction anddisplay a function area included in the service page in response to aflick or drag manipulation being input in the vertical direction.

One of the plurality of service pages may be a main page, and the mainpage may include an information display area of the home network and atleast one favorite function area that is displayable according to a usermanipulation in the second direction.

In response to a new device being added to the home network, the controlunit may add at least one of a new service page and a new function area.

The plurality of service pages may include at least one of a controlservice page providing a control menu for respectively controllingoperations of the plurality of devices, an energy service page providingenergy usage information of the plurality of devices, a monitoringservice page providing a monitoring service by using a photographingdevice of the plurality of devices, a media service page providing amedia service by using a media output device of the plurality ofdevices, and a mode service page for differently controlling theplurality of devices according to a home network mode.

A function area of the control service page may include the controlmenu, a function area of the energy service page may include periodicalenergy usage information of the plurality of devices, a function area ofthe monitoring service page may include data captured by one of theplurality of devices, a function area of the media service may include amenu for managing a file stored in at least one of the plurality ofdevices, a function area of the mode service page may include a modeexecution menu for executing one mode, and in response to the modeexecution menu being selected, the control unit may control devicesincluded in a group corresponding to the mode execution menu at onetime.

The plurality of service pages may respectively include service summaryareas. In response to a service summary area of one service page beingdisplayed and a user manipulation in the second direction beingperformed, the control unit may move and display at least one functionarea connected to the service summary area onto the service summaryarea.

In response to the at least one function area being displayed on thedisplay unit and an enlarge menu icon of one function area beingselected, the control unit may enlarge the one function area to adetailed function area and display the detailed function area in a wholearea of the display unit.

In response to the at least one function area being displayed on thedisplay unit and a pinch gesture being input, the control unit mayreduce the at least one function area to corresponding objects anddisplay the corresponding objects and, in response to one of the objectsbeing selected, change the selected object to a function area anddisplay the function area.

The user terminal apparatus may further include a rotation sensing unitconfigured to sense a rotation of the user terminal apparatus. Thecontrol unit may display the main page according to a first layout inresponse to the display unit being oriented in the vertical directionand display the main page according to a second layout in response tothe display unit being oriented in the horizontal direction.

The first layout may be a layout in which the information display areaof the home network and at least one favorite function area areconnected in a second axis direction based on the information displayarea of the home network, and the second layout may be a layout thatincludes a plurality of state information areas indicating stateinformation of respective rooms included in an environment managed bythe home network.

According to another non-limiting aspect of the technology describedherein, a method of managing a home network of a user terminal apparatusincludes, in response to an application for managing the home networkincluding a plurality of devices, being executed, displaying a firstservice page of a plurality of service pages for managing the homenetwork; in response to the first service page being displayed and auser manipulation in a first direction being input, displaying a secondservice page connected to the first service page; and in response to thefirst service page or the second service page being displayed and a usermanipulation in a second direction, displaying a function area comprisedin the first service page or the second service page. The plurality ofservice pages may be pages for respectively providing different homenetwork management services.

The method may further include: in response to one of the plurality ofservice pages being selected, displaying a function area subordinate tothe service page on a display unit.

The method may further include: in response to a new device being addedto the home network, adding at least one of a new service page and a newfunction area.

The one of the plurality of service pages may be a main page, and themain page may include an information display area of the home networkand at least one favorite function area that is displayable on a displayunit according to a user manipulation in the second direction.

The plurality of service pages may respectively include service summaryareas and at least one function area connected to the service summaryareas. The displaying of the at least one function area may include: inresponse to the at least one function area being displayed and a usermanipulation in the second direction being performed, moving anddisplaying the at least one function area onto the service summaryareas.

The method may further include: in response to the at least one functionarea being displayed and an enlarge menu icon of one function area beingselected, enlarging the one function area to a detailed function areaand displaying the detailed function area.

The method may further include: in response to at least one functionarea being displayed and a pinch gesture being input, reducing the atleast one function area to corresponding objects and displaying thecorresponding objects, and in response to one of the reduced objectsbeing selected, changing the selected object to a function area anddisplaying the function area.

The method may further include: in response to the main page beingdisplayed and a display unit of the user terminal apparatus beingoriented in a vertical direction, displaying the main page according toa first layout, and in response to the display unit being oriented in ahorizontal direction, displaying the main page according to a secondlayout.

According to various example embodiments as described above, a homenetwork service user interface (UI) screen that reflects various needsof a user may be provided. Therefore, the user may further intuitivelyand efficiently use various services.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example UI screen for managing a home networkaccording to a non-limiting example embodiment.

FIGS. 2, 3 and 4 illustrate a layout of an example UI screen formanaging a home network according to a non-limiting example embodiment.

FIGS. 5, 6, 7 and 8 illustrate an example home network system forproviding a home network management service according to variousnon-limiting example embodiments.

FIG. 9 is a block diagram of an example user terminal apparatusaccording to a non-limiting example embodiment.

FIG. 10 illustrates a main page of an example UI screen for managing ahome network according to a non-limiting example embodiment.

FIGS. 11A, 11B, 11C, 11D, 12A, 12B and 12C illustrate a function areathat is included in an example home network management service pageaccording to various non-limiting example embodiments.

FIG. 13 is a block diagram of a detailed structure of an example userterminal apparatus according to a non-limiting example embodiment.

FIGS. 14A, 14B, 14C, 15A, 15B, 16 and 17 illustrate an example main pageaccording to various non-limiting example embodiments.

FIGS. 18, 19, 20, 21, 22, 23, 24 and 25 illustrate an example firstservice page according to various non-limiting example embodiments.

FIGS. 26, 27, 28, 29, 30, 31, 32, 33 and 34 illustrate an example secondservice page according to various non-limiting example embodiments.

FIGS. 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47 and 48illustrate an example third service page according to variousnon-limiting example embodiments.

FIGS. 49 and 50 illustrate an example fourth service page according tovarious non-limiting example embodiments.

FIGS. 51, 52, 53, 54 and 55 illustrate an example fifth service pageaccording to various non-limiting example embodiments.

FIGS. 56, 57, 58 and 59 illustrate an example sixth service pageaccording to various non-limiting example embodiments.

FIGS. 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72 and 73illustrate an example setting screen according to various non-limitingexample embodiments.

FIG. 74 is a flowchart of an example method of managing a home networkof a user terminal apparatus according to a non-limiting exampleembodiment.

FIGS. 75 and 76 illustrate map information that is provided by anexample user terminal apparatus according to a non-limiting exampleembodiment.

FIG. 77 illustrates a method of operating an example user terminalapparatus according to another non-limiting example embodiment.

FIGS. 78, 79, 80 and 81 illustrate an example user terminal apparatusthat is realized as a TV according to another non-limiting exampleembodiment.

DETAILED DESCRIPTION

Example embodiments are described in greater detail with reference tothe accompanying drawings.

In the following description, the same drawing reference numerals areused for the same elements in different drawings. The matters defined inthe description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of the exampleembodiments. Thus, it is apparent that the example embodiments may becarried out without those specifically defined matters. Also, well-knownfunctions or constructions are not described in detail to avoidobscuring the example embodiments with unnecessary detail.

FIG. 1 illustrates an operation of an example user terminal apparatusaccording to a non-limiting example embodiment. A user terminalapparatus 200 is an element that receives a user manipulation by usingvarious types of input devices or units such as a touch screen, a mouse,a keyboard, a touchpad, a button, a microphone, a camera, etc. andperforms a control operation corresponding to the user manipulation. Indetail, the user terminal apparatus 200 may be realized as various typesof devices or apparatuses such as a portable phone, a mobile phone, asmart phone, a laptop personal computer (PC), a tablet PC, a personaldigital assistant (PDA), a PC, a TV, a home network control apparatus,etc. The user terminal apparatus 200 may be variously referred to as amanagement apparatus, a control apparatus, a display apparatus, etc. butis referred to herein as the user terminal apparatus 200.

A user may manage a home network system 500 by using the user terminalapparatus 200. The user terminal apparatus 200 displays a UI screen thatis designed so as to enable the user to manage the home network system500. Home network management is a concept including control of devicesconnected to one another through a network in a home, analyses of statesof the devices, sensing of dangerous situations in the home, informationexchanges between family members, etc. and is possible through the userterminal apparatus 200.

Referring to FIG. 1, a UI screen that is displayed through a displayunit 220 of the user terminal apparatus 200 is a part of one of aplurality of service pages 100-1 through 100-7.

A service page may refer to, for example, a page including a servicesummary area and at least one function area. The plurality of servicepages are pages for respectively providing different home networkmanagement services. The plurality of service pages may be changedaccording to a user manipulation in a first direction. Also, at leastone of the service pages may include a function area that is displayedaccording to a user manipulation in a second direction. The servicepages may be connected to one another and may be separately displayed onthe display unit 220 according to a user manipulation. Also, the firstdirection may correspond to a horizontal direction, and the seconddirection may correspond to a vertical direction, but the first andsecond directions are not necessarily limited in this respect.

A direction may be changed on the display unit 220 according to settingsto display the UI screen. For example, the user terminal apparatus 200may include a gravity sensor, and a control unit may change a directionof the UI screen so as to enable the UI screen to correspond to aspectsof an orientation of the user terminal apparatus 200. Therefore, thevertical direction and the horizontal direction may be determinedaccording to a direction of a screen displayed on the display unit 220.The horizontal direction may be a direction displayed from left to rightor from right to left on the displayed screen, and the verticaldirection may be a direction displayed from top to bottom or from bottomto top.

As shown in FIG. 1, a service summary area 110-1 of a main service 100-1of a plurality of service pages is currently displayed on the displayunit 220. For example, if a user manipulation in a first direction isinput, a service summary area 110-2 of a monitoring service page 100-2connected to (or accessible via) the main page 100-1 may be displayed.As another example, if a user manipulation in a second direction isinput when the service summary area 110-1 of the main page 100-1 isdisplayed, at least one favorite function area 120-1, 122-1, and 124-1connected to (or accessible via) the service summary area 110-1 may bedisplayed.

For convenience of description, respective service pages are designatedas shown in FIG. 1. However, the arrangement order and designation ofservice pages is not limited to that shown in FIG. 1, and may involveother types of service pages, designs of service pages, etc.

UI screens having different characteristics may be arranged in the firstand second directions. For example, service screens for managing a homenetwork may be arranged in the first direction, and screens forcontrolling functions of devices included in the home network may bearranged in the second direction. Also, the screens for controlling thefunctions of the devices used for providing corresponding services onthe service screens arranged in the first direction may be respectivelyarranged in the second direction.

FIG. 1 illustrates a whole structure of a UI screen provided by the userterminal apparatus 200 according to an example embodiment. The UI screenmay provide various home network management services and includes screendesigns, structures, information, etc. appropriate for servicecharacteristics.

The display unit 220 of the user terminal apparatus 200 may display apart of the whole structure of the UI screen shown in FIG. 1 accordingto a user manipulation direction.

Referring to FIG. 1, the example UI screen for managing the home networkis a screen on which one of a plurality of service pages 100-2 through100-7 is displayed. Here, the plurality of service pages 100-2 through100-7 are arranged in the first direction relative to the main page100-1. In FIG. 1, a horizontal direction may be the first directionbased on the display unit 220 of the user terminal apparatus 200, and avertical direction may be the second direction. However, the first andsecond directions are not limited to this arrangement. For example, thevertical direction may be set to the first direction, and the horizontaldirection may be set to the second direction. Alternatively, a third orfourth direction that is a diagonal direction may be additionally set.

The user inputs a user manipulation to directly touch a surface of thedisplay unit 220 so as to perform flicking or dragging in the first orsecond direction. However, types of user manipulations are not limitedthereto. For example, the user may change a screen by using a touch penor may change the screen by using a direction button, a wheel button, orthe like. Also, the user may manipulate a UI screen by using a motion(e.g. tilting the user terminal apparatus 200) or a voice. Exampleembodiments where a UI is changed according to a touch manipulationmethod of directly touching a screen by a user will now be described.

If an icon corresponding to a home network function is selected so as toperform the home network function on the user terminal apparatus 200 orthe user terminal apparatus 200 is turned on to be booted-up, the userterminal apparatus 200 may display the main page 100-1. Alternatively, acurrently used service page may be displayed.

The main page 100-1 is an initial page that is provided from a homenetwork management service and may include a home network situation,environment information such as time, weather, etc., an external trafficsituation, etc. Besides these, other types of information, such asvarious types of information released in relation to a home networkmanagement, news updates, a danger (e.g., extreme weather conditions)guide message, etc. may be displayed on the main page 100-1. The mainpage 100-1 may alternatively be referred to as an initial page, a homepage, a landing page, etc.

Referring to FIG. 1, the main page 100-1 includes an information displayarea 110-1 for displaying information about a home network and theplurality of favorite function areas 120-1, 122-1, and 124-1 that aresequentially arranged in the second direction under the informationdisplay area 110-1.

At least one or more service pages may be connected to the main page100-1. In FIG. 1, the plurality of service pages 100-2 through 100-7 areconnected to the main page 100-1 along the first direction. Informationabout various services for managing the home network may be respectivelydisplayed on the service pages 100-2 through 100-7.

In detail, referring to FIG. 1, the plurality of service pages 100-2through 100-7 respectively include service summary areas 110-2 through110-7 and a plurality of function areas 120-2, 122-2, 120-3, 122-3,120-4, 122-4, 120-5, 122-5, 120-6, 122-6, 120-7, and 122-7 that aresequentially arranged in the second direction under correspondingservice summary areas 110-2 through 110-7.

Here, function areas may refer, for example, to areas that may directlyselect or control functions respectively provided from service pages.For example, if a third service page 100-4 is used to display controlservices of devices in a home, an arbitrary function area included inthe third service page 100-4 may be a function area for controlling a TVor an air conditioner.

When a TV control function area is displayed on the display unit 220,the user may immediately turn a TV on or off or control a volume, achannel, or the like through the TV control function area.

The plurality of service pages 100-2 through 100-7 may respectivelyfurther include additional menus (e.g., menus 124-2 and 124-3). The usermay select an additional menu to add a new function area into acorresponding service page.

The user of the user terminal apparatus 200 may perform a userinteraction by using each UI screen arranged according to the first orsecond direction. In detail, the user may perform dragging or flickingalong the first or second direction to change a UI screen. A userinteraction method will now be described in detail.

When a summary area of a service page is displayed, the user may call afunction area. A first service page 100-2 will be described by way ofexample and without limitation. A plurality of function areas includedin the first service page 100-2 may sequentially go up onto and bedisplayed in a summary area 110-2 of a first service according to a usermanipulation (e.g., a manipulation for performing dragging or flickingupwards after performing touching) in the second direction. In thiscase, according to example embodiments, summary areas may be maintained,and function areas may respectively overlap and be displayed on thesummary areas or the summary areas may be pushed upwards to graduallydisplay the function areas. Alternatively, a screen change may beimmediately performed according to display sizes. In other words, if theuser inputs a user manipulation upwards along the second direction whenthe summary area 110-2 is displayed, the summary area 110-2 may bechanged into two function areas 120-2 and 122-2 right under the summaryarea 110-2. Alternatively, a favorite function area or a function areamay be displayed on the display unit 220 in the manner of a card takenout of a wallet. Therefore, a function area may be written as variousterms such as a card, a tag, a function section, etc. The word “card” isused in FIG. 1 in consideration of a characteristic of such a functionarea.

If a user manipulation is input downwards along the second directionwhen a function area is displayed, the display unit 220 may re-displaythe summary area 110-2.

A detailed operation performed according to a user input will now bedescribed. For example, if a first user manipulation 10 in the first(horizontal) direction is input when the information display area 110-1of the main page 100-1 is currently displayed on the display unit 220,the display unit 220 displays a first summary area 110-2 of the firstservice page 100-2. In this case, the information display area 110-1 maybe immediately changed into the first service summary area 110-2 or maybe changed to be pushed to the left so as to enable the first servicesummary area 110-2 to be gradually displayed from the left direction.Alternatively, a screen may be changed so as to enable the first servicesummary area 110-2 to be overlaid on the information display area 110-1.

As another example, as shown in FIG. 1, if a second user manipulation 20in the second direction is input when the information display area 110-1of the home network of the main page 100-1 is currently displayed on thedisplay unit 220, the display unit 220 displays at least one of theplurality of favorite function areas 120-1, 122-1, and 124-1 of the mainpage 100-1. Here, the plurality of favorite function areas 120-1, 122-1,and 124-1 correspond to function areas of function areas of respectiveservice pages that are registered as bookmarks.

If a user manipulation is input in a left direction along the firstdirection when a plurality of favorite function areas are displayed, thedisplay unit 220 may immediately display the corresponding functionareas 120-2 and 122-2 on the first service page 100-2 or may display thefirst service summary area 110-2.

As shown in FIG. 1, the main page 100-1 and the service pages 100-2through 100-7 may be formed in larger sizes than a display size of thedisplay unit 220. Also, in the pages 100-1 through 100-7, a size of theinformation display area 110-1 or sizes of service summary areas 110-2through 110-7 may be equal to the display size of the display unit 220.On the contrary, sizes of favorite function areas or function areas maybe smaller than the display size of the display unit 220. Therefore,when favorite function areas or function areas are displayed, aplurality of favorite function areas or a plurality of function areasmay be displayed within one screen.

The whole structure of the UI screen for managing the home network hasbeen described above with reference to FIG. 1, and a layout of each UIscreen for managing a home network will now be described with referenceto FIGS. 2 through 4.

FIG. 2 illustrates a layout of a main page according to an exampleembodiment. Referring to FIG. 2, a main page 100-1 may include a titlearea 130-1 and an information display area 110-1 of a home network.

A title of a home network may be displayed in the title area 130-1. If auser does not input a particular profile, a default title may bedisplayed. For example, a title “Smart Home” may be displayed by defaultin the title area 130-1 of the main page. After that, if the user storesa particular profile, a title may be changed according to, for example,a user name For example, if the user is a user AAA, a title “AAA's Home”may be displayed in the title area 130-1. Also, title area 130-1 of themain page may include a menu area 132-1, and, if the menu area 132-1 ofthe main page is selected, a menu may be displayed, which may beprovided on the main page 100-1, or may be changed into a historyscreen. This will be described in more detail with reference to FIGS. 15and 16.

The information display area 110-1 of the home network may include abriefing area 112-1 that displays briefing contents, an information area114-1 that displays information provided on the main page 100-1, and acue area 116-1 of a favorite function area for indicating that at leastone of a plurality of favorite function areas 120-1, 122-1, and 124-1 ispositioned at the bottom. If the cue area 116-1 of the favorite functionarea is touched for input of a user manipulation for performing upwarddragging, the plurality of favorite function areas 120-1, 122-1, and124-1 may be sequentially displayed in the information display area110-1.

FIG. 3 illustrates a layout of a first service page 100-2 of a pluralityof service pages 100-2 through 100-7 according to an example embodiment.Layouts of the other service pages are similar to the layout of thefirst service page 100-2.

Referring to FIG. 3, the first service page 100-2 may include a titlearea 130-2 and a service summary area 110-2.

The title area 130-2 of the first service page displays “Smart Home” bydefault and, if the user stores a profile, may be changed so that “UserName's Home” is displayed. Also, the title area 130-2 of the firstservice page may include a menu area 132-2 and, if the menu area 132-2of the first service page is selected, a menu may be provided on thefirst service page 100-2.

The first service summary area 110-2 may include a first service titlearea 112-2 that displays a first service name, a first servicedescription area 114-2 that displays description contents or a currentstate of a first service, and a first service information area 116-2that displays main information provided on the first service page 100-2.Here, a tip object 119-2 that calls a description of displayedinformation may be provided in the first service information area 116-2.When the tip object 119-2 is selected, a description of a correspondingfunction may be displayed.

The first service summary area 110-2 may include an inter-serviceindicator 117-2 and a cue area 118-2 of a function area of the firstservice for indicating that at least one of a plurality of functionareas 120-2, 122-2, and 124-2 of the first service is positioned belowthe service page 110-2. When the cue area 118-2 of the function area ofthe first service is touched to input the second manipulation 20 of theuser for performing dragging in the second direction, the plurality offunction areas 120-2 and 122-2 of the first service may be overlaid inthe first service summary area 110-2 as shown in FIG. 4.

As shown in FIG. 4, the plurality of function areas 120-2 and 122-2 ofthe first service may include a title area 1 that provides a sub titleif a title and an additional content of a function area are needed, aninformation area 4 that displays contents of the corresponding functionarea, a bookmark icon 2, and an enlarge menu icon 3. If the bookmarkicon 2 is selected, the corresponding function area is added to a newfavorite function area of the main page 100-1. In other words, the usermay check a function area, which is registered with a bookmark, on themain page 100-1 without passing through the first service page 100-2.

If the enlarge menu icon 3 is selected, the corresponding function areais enlarged, and detailed information of the corresponding function areais displayed.

Also, the plurality of function areas 120-2 and 122-2 of the firstservice may be moved in the second direction according to a usermanipulation in the second direction. Here, a scroll bar 6 may bedisplayed.

A UI screen according to various example embodiments as described aboveprovides a unifying design of each service. Also, a change betweenservice screens and a detailed function that is provided by a servicemay be intuitively called according to a user manipulation in the firstor second direction.

A structure of a UI screen for managing a home network may be variouslychanged to be appropriate for a user taste or may be adaptively changedaccording to a change in an environment of a home network system. Thisexample embodiment will now be described in more detail with referenceto FIGS. 5 through 8.

FIGS. 5 and 6 illustrate a home network system according to variousexample embodiments.

Referring to FIG. 5, a home network system 500 is connected to a userterminal apparatus 200 and includes a home server 510 and a plurality ofclient devices 520-1, 520-2, 520-3, . . . , and 520-6 connected to thehome server 510.

The home server 510 may control and manage the client devices 520-1,520-2, 520-3, . . . , and 520-6 connected to the home network, and mayoperate with the client devices 520-1, 520-2, 520-3, . . . , and 520-6.In detail, the home server 510 may take charge of a service remotemanagement function from an external network, audio, video, game,digital broadcasting server, energy management, home automation, andsecurity server functions in a home, etc. The home server 510 may existas an independent device or may be mounted on another device.

The user terminal apparatus 200 may communicate with the home server 510to transmit a control command or the like for controlling the pluralityof client devices 520-1, 520-2, 520-3, . . . , and 520-6 or receivevarious types of state information of the plurality of client devices520-1, 520-2, 520-3, . . . , and 520-6, danger situation sensinginformation of the home, or the like.

Also, the user terminal apparatus 200 may be provided with a new servicepage or a template of a new function area UI from the home server 510 tochange a UI screen configuration according to a user taste.

According to another example embodiment, the home network system 500 mayinclude a gateway and communicate with an external server apparatus 600.Referring to FIG. 6, in detail, the home network system 500 may includea gateway 530 and a plurality of client devices 520-1, 520-2, 520-3, . .. , and 520-6 connected to the gateway 530.

The gateway 530 is an apparatus that provides an interconnection betweena network in a home and an external network and operates as a hub thatconnects and manages the plurality of client devices 520-1, 520-2,520-3, . . . , and 520-6. In detail, the gateway 530 may control andmanage devices by using wired and/or wireless communication technologyand access an external network (e.g., the Internet) to provide variousservices such as video on demand (VOD), remote control, etc.

In particular, the gateway 530 may transmit a control command, which isprovided from the external server apparatus 600, to the plurality ofclient devices 520-1, 520-2, 520-3, . . . , and 520-6 or may collectstate information from the plurality of client devices 520-1, 520-2,520-3, . . . , and 520-6 and transmit the state information to theserver apparatus 600. In this case, the user terminal apparatus 200 maytransmit a control command or the like for controlling the plurality ofclient devices 520-1, 520-2, 520-3, . . . , and 520-6 or may receivevarious types of state information or the like from the plurality ofclient devices 520-1, 520-2, 520-3, . . . , and 520-6.

The user terminal apparatus 200 may also be provided with a new servicepage or a UI template of a new function area from the server apparatus600 to change a UI screen configuration according to a user taste. Inthis case, the UI template stored in the server apparatus 600 may beupdated by a server manager.

Referring to FIG. 6, the user terminal apparatus 200 may communicatewith a second home network system 700 connected to the server apparatus600. For example, the user may check state information of a parent'shome through the user terminal apparatus 200 and receive informationsuch as a message or the like indicating, for example, that a gas rangeis turned on for a long time in the parent's home. A care report serviceas described above will be described later in more detail with referenceto FIGS. 49 and 50.

A new device that is added to a home network system will now bedescribed with reference to FIG. 7.

Referring to FIG. 7, if a new device 520-7 is added, the user terminalapparatus 200 that communicates with the home network system 500 mayprovide device addition information to the user. For example, the homeserver 510 or the server apparatus 600 may collect meta informationabout a new device and transmit new device information to the userterminal apparatus 200. Also, a new device may be registered in the homenetwork system 500 according to user settings. In this case, the userterminal apparatus 200 may generate a new UI screen of a new device orchange and display an existing UI screen configuration. In detail, thehome server 510 or the server apparatus 600 may analyze meta informationof a device to transmit a UI template appropriate for a functionprovided by the device to the user terminal apparatus 200. The userterminal apparatus 200 may configure a new UI screen by using thereceived UI template.

In detail, referring to FIG. 8, a new service page 100-8 correspondingto the new device 520-7 may be generated, and a plurality of functionareas A-2, C-1, and C-2 of a plurality of functions that may beperformed by the new device 520-7 may be included in existing servicepages 100-2 and 100-3 or a new service page 100-8.

For example, as shown in FIG. 7, if the new device 520-7 is a camera,the home network system 500 may newly provide a monitoring service thatdisplays an image captured by the camera 520-7. Therefore, the userterminal apparatus 200 may add the new service page 100-8 associatedwith the monitoring service onto a UI screen. If a plurality of cameras520-7 exist and are installed all over environment of a home, the userterminal apparatus 200 may provide images of areas where the cameras520-7 are respectively installed. In this case, a plurality of functionareas for controlling operation of cameras respectively installed inareas may be newly added. For example, a main room monitoring functionarea C-1 and a baby room monitoring function area C-2 may be included inthe new service page 100-8. In this case, if a service provided from afirst service page 100-2 is a control service, a function area A-2 forcontrolling on/off switching of a monitoring camera may be added ontothe first service page 100-2.

If an existing device is deregistered on the home network system 500, aservice page or an associated function area associated with the existingdevice may be automatically deleted or a message for inquiring aboutwhether to delete the service page or the associated function area maybe displayed through the display unit 220. In other words, a UI screenconfiguration displayed on the user terminal apparatus 200 may beadaptively changed according to changes in an environment of the homenetwork system 500.

The user terminal apparatus 200 that provides a UI screen for managing ahome network as described above will now be described in detail.

FIG. 9 is a block diagram of a structure of the user terminal apparatus200 according to an example embodiment. Referring to FIG. 9, the userterminal apparatus 200 includes a communication unit 210, the displayunit 220, a sensing unit 230, and a control unit 240.

The communication unit 210 may, for example, be circuitry or somearrangement of hardware, software and firmware configured to enablewired and/or wireless communication with various types of externaldevices or external servers according to various types of communicationmethods. In particular, the communication unit 210 may be connected tothe home network system 500 to receive information about client devicesincluded in a home network or transmit a control command to the clientdevices.

If a new device is added to the home network, the communication unit 210may receive information about the new device and receive a new UItemplate of the new device.

The display unit 220 may, for example, be one or more displays (e.g.,CRT, LCD, OLED and the like) configured to display various types of UIscreens as described above. A UI screen refers to a display screen thatprovides various types of information or menus to a user and performs auser interaction according to an action of the user for the varioustypes of information or menus. As shown in FIG. 1, if a UI screen isformed of various pages, and sizes of the pages are larger than adisplay size, the display unit 220 may display at least a part of the UIscreen for managing a home network.

The sensing unit 230 may, for example, be one or more sensors configuredto sense various manipulations such as a touch on the user terminalapparatus 200, a rotation, a slope, and a pressure supplied to the userterminal apparatus 200, an access to the user terminal apparatus 200,etc. In particular, the sensing unit 230 may include a touch sensor (notshown) and a rotation sensor (not shown).

In detail, various touches of the user on the touch sensor may beassociated with executions of various functions. For example, thevarious touches of the user may be classified into an operation (or tap)of pressing (or touching) and withdrawing from a screen, an operation(or a double tap) of consecutively pressing the screen two times andthen withdrawing from the screen, an operation (or a long tap) of (long)pressing the screen for a preset time or more or withdrawing from thescreen, an operation (or a drag) of pressing a point of the screen for apreset time or more and dragging the point to another point, anoperation (or a swipe) of swiping the screen in a preset direction at apreset speed, an operation (pinch in) of pressing the screen with twofingers and closing the two fingers together, an operation (pinch out)of pressing the screen with two fingers and spreading the two fingersapart, etc.

The rotation sensor may include, for example, a geomagnetic sensor, anacceleration sensor, and/or the like for sensing aspects of a rotationstate, a movement direction, etc. of the user terminal apparatus 200.

The control unit 240 may, for example, include a processor (e.g.,executing appropriate software), an application specific integratedcircuit (ASIC), floating point gate array, and/dedicated circuitryconfigured to control an overall operation of the user terminalapparatus 200. The control unit 240 may operate with elements such asthe communication unit 210, the sensing unit 230, the display unit 220,etc. to perform control operations described above according to variousexample embodiments.

If an application for managing the home network is executed, the controlunit 240 controls the display unit 220 to display a UI screen as shownin FIG. 10. If a user manipulation is sensed by the sensing unit 230 inthis state, the control unit 240 may change the UI screen or control thehome network according to the user manipulation. In detail, the controlunit 240 may control the display unit 240 to sequentially display themain page 100-1 and a plurality of service pages 100-2, 100-3, 100-4, .. . , and 100-7 page by page according to the first user manipulation 10performed sequentially in the first direction. The control unit 240 mayalso control the display unit 220 to display a plurality of functionareas according to the second user manipulation 20 performed in thesecond direction.

If a home network management is started, the control unit 140 may firstcontrol display unit 220 to display the main page 100-1. The main page100-1 may provide various types of information. For example, the mainpage 100-1 may include a light button 114 b-1, a temperature button 114c-1, and a standby power button 114 d-1. If an arbitrary button isselected from these buttons, a detail control window may be displayed ina pop-up form.

For example, if the standby power button 114 d-1 is selected, a messagewindow “Do you want to cut off standby power in your home (excluding amonitoring device and a refrigerator)?” may be displayed. Also, if aselection button included in the message window is selected, anoperation of cutting off power in a home may be performed.

As another example, referring to FIG. 10, the main page 100-1 mayinclude a plurality of user icons 114 e-1, 114 f-1, and 114 g-1respectively corresponding to family members in a family member currentstate area. If one of the plurality of user icons 114 e-1, 114 f-1, and114 g-1 is selected, a message pop-up window 114 h-1 for sending amessage to a corresponding family member may be output. Here, if one ofa phone button, a message button, and a chatting button is selected, thecontrol unit 240 may place a phone call to a corresponding family memberor output a window or a chatting window for sending a message based on aphone directory stored in a storage unit (not shown).

According to another example embodiment, if a vertical rotation of theuser terminal apparatus 200 is sensed by the sensing unit 230 when themain page 100-1 is displayed, the control unit 240 displays the mainpage 100-1 according to a layout different from a layout of thedisplayed main page 100-1.

For example, referring to FIG. 10, when the display unit 220 is orientedin a portrait direction, the control unit 240 displays the main page100-1 in a layout where the information display area 110-1 of the homenetwork and the first favorite function area 120-1 are connected to eachother in a second direction based on the information display area 110-1of the home network. When the display unit 220 is oriented in alandscape direction, the control unit 240 may display the main page100-1 in a layout so as to include a plurality of state informationareas 30, 40, and 50 indicating state information about respective roomsincluded in an environment managed by the home network. A rotationoperation of the user terminal apparatus 200 as described above may besensed by the sensing unit 230.

If the main page 100-1 is displayed in a second layout as shown in FIG.10, for example, the user may select a light button 31 of a first roomto switch on/off lights in that room. If a light for a respective roomis switched on or off, background colors of the corresponding stateinformation areas 30, 40, and 50 may be changed. The user may alsoselect a temperature button 32 of the first room to control temperatureof that room. For example, if the temperature button 32 of the firstroom is selected, a screen may be changed into one for setting atemperature level. Here, an animation effect may be applied to turn thefirst state information area 30 corresponding to the first room from afront side to a back side.

Also, at least one favorite function area of the main page 100-1corresponds to at least one of function areas registered with bookmarks,among function areas included in each service page. The bookmarkregistration may be performed through a selection of the bookmark menuicon 2 provided in each function area as described above with referenceto FIG. 4.

For example, if the second user manipulation 20 is input when the firstservice summary area 110-2 of the first service page 100-2 is displayedas shown in FIG. 11A, the control unit 240 may move and display at leastone function area connected to the first service summary area 110-2 ontothe first service summary area 110-2 as shown in FIG. 11B. Here, thesecond user manipulation 20 may be an operation of dragging a cue area118-2 of a function area of a first service for indicating that at leastone of a plurality of function areas 120-2 and 122-2 exists, upwards.

If the cue area 118-2 of the function area of the first service isdragged upwards as shown in FIG. 11D, the plurality of function areas120-2 and 122-2 of the first service may be sequentially moved onto thefirst service summary area 110-2 along with the dragging operation.Here, if the enlarge menu icon 3 provided in each of the plurality offunction areas 120-2 and 122-2 of the first service is selected, thecontrol unit 240 may enlarge the first function area 120-2 of thecorresponding first service into a first detailed function area 126-2 ofthe first service and display the first detailed function area 126-2 ona front surface of the display unit 220 as shown in FIG. 11D.

According to another example embodiment, if a pinch gesture 30 is inputin a state in which a plurality of function areas 120-2, 122-2, and124-2 of a first service are displayed as shown in FIG. 12A, the controlunit 240 may reduce the plurality of function areas 120-2, 122-2, and122-3 of the first service to a plurality of corresponding firstfunction area objects 120′ -2, 122′ -2, 124′ -2, 126′ -2, 128′ -2, and129′ -2 and display the plurality of the corresponding first functionarea objects 120′ -2, 122′ -2, 124′ -2, 126′ -2, 128′ -2, and 129′ -2 asshown in FIG. 12B. If a method as described above is used, the user maycheck a plurality of function areas in one view.

Here, if one of the reduced first function area objects is selected asshown in FIG. 12B, the control unit 240 may change the selected firstfunction area object 120′ -2 back into the first function area 120-2 ofthe first service and display the first function area 120-2 as shown inFIG. 12C.

Also, if a new device is added to the home network, the control unit 240may add at least one of a new service page and a new function area. Asdescribed above with reference to FIG. 8, the control unit 240 maygenerate a new service page or a new function area by using a new UItemplate.

The user terminal apparatus 200 may be realized in various manners andtypes of devices to perform a method of managing a home networkaccording to various example embodiments as described above.

FIG. 13 is a block diagram of a detailed structure of the user terminalapparatus 200 according to an example embodiment. Referring to FIG. 13,the user terminal apparatus 200 includes a communication unit 210, adisplay unit 220, a touch sensor 231, a rotation sensor 233, a controlunit 240, and a storage unit 250.

The communication unit 210 is an element for communicating with varioustypes of external devices or external servers according to various typesof communication methods. The communication unit 220 may include varioustypes of communication chips (or integrated circuits) such as a WiFichip 211, a Bluetooth chip 212, a wireless communication chip 213, anNFC chip 214, and the like. The WiFi chip 211, the Bluetooth chip 212,and the NFC chip 214 respectively perform communications according to aWiFi method, a Bluetooth method, and an NFC method. The NFC chip 214refers to a chip that operates in a Near Field Communication (NFC)method using a band of 13.56 MHz among various types of RF-ID frequencybands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, 2.45 GHz, etc.If the WiFi chip 211 or the Bluetooth chip 212 is used, thecommunication unit 210 may transmit and receive various types ofconnection information such as an SSID, a session key, etc., and connectcommunications by using the various types of connection information, andtransmit and receive various types of information. The wirelesscommunication chip 213 refers to a chip that performs communicationsaccording to various types of communication standards such as IEEE,Zigbee, 3^(rd) Generation (3G), 3^(rd) Generation Partnership Project(3GPP), Long Term Evoloution (LTE), and the like.

In particular, the communication unit 210 is connected to the homenetwork system 500 to receive information about client devices in a homenetwork and/or transmit a control command to the client devices. Also,if a new device is added to the home network, the communication unit 210may receive meta information about the new device or a new UI templateappropriate for the new device.

The user terminal apparatus 200 may communicate with various types ofexternal devices, such the home server 510, the server apparatus 600,etc., through the communication unit 210.

The display unit 220 is one or more displays for displaying a screenincluding at least one object. Here, the screen refers to an image framethat is provided through the display unit 210 in the user terminalapparatus 200. In detail, a home screen, an icon screen, a list screen,an application execution screen, a web browser screen, a content playscreen, etc. may be included in the screen. Also, object icons refer tovarious shapes that are displayed in the screen like a text, a photo, awidget, etc. In particular, the display unit 220 may display varioustypes of UI screens for managing a home network as described above.

The touch sensor 231 may sense a user manipulation that is performed onthe display unit 220. If the user touches the screen with a finger or apen to perform drawing, the touch sensor 231 may sense a place where thedrawing is performed and a trajectory of the drawing. The touch sensor231 may be realized using various types of touch sensors such as acapacitive type, a decompressive type, a piezoelectric type, and thelike. The capacitive type is a method of sensing micro-electricityexcited into a body of the user to calculate touch coordinates by usinga dielectric coated on a surface of the display unit 220 when a part ofthe body of the user touches the surface of the display unit 220. Thedecompressive type is a method of sensing a current flowing due to acontact between upper and lower electrode plates of the display unit 220at a point of the screen touched by the user to calculate touchcoordinates.

The touch sensor 231 may sense a user manipulation that is performed byusing an input unit such as a pen, in addition to a finger of the user.If the input unit is a stylus pen including a coil, the touch sensor 231may include a magnetic field sensor that may sense a magnetic fieldchanged by the coil of the stylus pen. Therefore, the touch sensor 231may sense a touch manipulation and a proximity manipulation, i.e.,hovering.

If a user manipulation is sensed, the touch sensor 231 provides thecontrol unit 240 with the sensing result. For example, if the usertouches a point of the screen with the finger or the pen, the touchsensor 231 provides the control unit 240 with x, y coordinate values ofthe touch point. If the user moves the touch point when touching thescreen, the touch sensor 231 provides the control unit 240 with touchcoordinate values, which are changing, in real time. As described above,the touch sensor 231 may sense a close approach rather than a directtouch.

The rotation sensor 230 senses aspects of a rotation state, a movementdirection, orientation, and the like of the user terminal apparatus 200.A geomagnetic sensor, an acceleration sensor, a gyro sensor, and/or thelike may be used as a sensor for sensing the rotation state, themovement direction and/or the orientation. The acceleration sensoroutputs a sensing value corresponding to acceleration changing accordingto an orientation of an apparatus or device to which the accelerationsensor is attached. The gyro sensor is a sensor that, if a rotationmotion occurs, measures a Coriolis force acting in a speed direction ofthe rotation motion to sense an angular speed. The geomagnetic sensor isa sensor for sensing an azimuth angle. If the rotation sensor 230 sensesthe rotation state of the user terminal apparatus 200, the control unit240 may differently display a layout of the main page 100-1 according tothe rotation state as described above with reference to FIG. 10.

The storage unit 250 may store an O/S 255 or programs such as varioustypes of applications and various types of data such as user settingdata, data generated in a process of executing an application, amultimedia content, etc. In particular, the storage unit 250 may storean application 251 for managing a home network. In FIG. 13, theapplication 251 is referred to as a smart home application. If the smarthome application is selected by the user or automatically executedaccording to a default setting value, the control unit 240 generates aUI screen as described in the above-described various exampleembodiments and displays the UI screen on the display unit 220. Thestorage unit 240 may also store a plurality of templates 253-1, 253-2, .. . , and 253-n. A template refers to data that defines a layout, atext, a menu, an icon, or the like for expressing a service page or afunction area as described above.

The control unit 240 may generate various types of UI screens asdescribed above by using the plurality of templates 253-1, 253-2, . . ., and 253-n. For example, if a new device is connected to the homenetwork system 500, the control unit 240 may determine a new servicethat may be provided by the new device. If the new service isdetermined, the control unit 240 may generate a new service page UIcorresponding to the new device by using the template 1 and generate anew function UI by using the template 2. This is described in detailwith reference to FIGS. 7 and 8, and thus a repeated description isomitted.

The storage unit 250 may also store a template that is updated in thehome server 510 or the server apparatus 600. In detail, the control unit240 may store a new template in the storage unit 250 or delete anexisting template from the storage unit 250 by using receivedinformation so as to efficiently manage a storage space of the storageunit 250.

The control unit 240 displays various types of UI screens for managingthe home network on the display unit 220 by using the programs and thedata stored in the storage unit 250.

The control unit 240 includes a RAM 241, a ROM 243, a CPU 245, a GraphicProcessing Unit (GPU) 247, and a bus 249. The RAM 241, the ROM 243, theCPU 245, and the Graphic Processing Unit (GPU) 247, and the like may beconnected to one another through the bus 249.

The CPU 245 accesses the storage unit 250 to perform booting up by usingthe O/S 255 stored in the storage unit 250. Also, various operations areperformed by using the smart home application 251, the plurality oftemplates 253-1, 253-2, . . . , and 253-n, and the like stored in thestorage unit 250.

The ROM 243 stores a command set and the like for booting up a system.If a turn-on command is input to supply power, the CPU 245 copies theO/S 255 stored in the storage unit 250 into the RAM 241 and executes theO/S 255 to boot the system according to a command stored in the ROM 243.If the booting up is completed, the CPU 245 copies various types ofprograms stored in the storage unit 250 into the RAM 241 and executesthe programs copied into the RAM 241 to perform various types ofoperations.

If booting up of the user terminal apparatus 200 is completed, the GPU247 displays a UI screen. In detail, the GPU 247 may generate a screenincluding various types of objects such as an icon, an image, a text,and the like by using an operator (not shown) and a renderer (notshown). The operator calculates attribute values, such as a coordinatevalues, shapes, sizes, colors, and/or the like, at which the objects areto be respectively displayed according to a layout of the screen. Therenderer generates a screen having various layouts including objectsbased on the attribute values calculated by the operator. The screengenerated by the renderer is provided to the display unit 220 to bedisplayed.

Besides this, although not shown in FIG. 13, according to exampleembodiments, the user terminal apparatus 200 may further include varioustypes of external input ports for connections to various types ofexternal terminals such as a USB port into which a USB connector may beconnected, a headset, a mouse, an LAN, etc., a DMB chip for receivingand processing a Digital Multimedia Broadcasting (DMB) signal, varioustypes of sensors, etc.

As described above, the user terminal apparatus 200 may be realized invarious shapes and structures. The control unit 240 of the user terminalapparatus 200 may display a UI screen for managing various types of homenetworks according to various example embodiments.

A UI screen for managing a home network according to various exampleembodiments will now be described in detail with reference to thedrawings.

<Main Page 100-1>

FIGS. 14A-14C illustrate the main page 100-1 according to an exampleembodiment.

The main page 100-1 is an initial page that is provided from a homenetwork management service and may include environment information, suchas an overall home network situation, time, weather, etc., externaltraffic situations, etc.

For example, referring to FIGS. 14A through 14C, the main page 100-1 mayinclude a briefing area 112-1 that provides various types ofnotifications of a home network management, a family user current statearea 118-1 that displays whether each family member is at home or out,an area 114 a-1 that provides notifications of abnormal situationsoccurring in a home such as a device abnormality occurrence, a securityproblem occurrence, an excessive energy usage, and the like, anindicator 117-1 for immediately moving onto a next service page, and thelike.

If an abnormality occurs in a robot cleaner (R/C) that is a device asshown in FIG. 14B as an example of a display state of the main page100-1, the control unit 240 may display an error message 1401 thatincludes a robot cleaner icon and an abnormality situation in the area114 a-1 that provides a notification of the abnormality situation. Asanother example, if a security problem and a device abnormality problemoccur together, the control unit 240 may display an image 1401 capturedfrom an intruder in the area 114 a-1 providing a notification of anabnormality situation and alternately display a message 1403 such as“Sense Motion During Absence. Storing of Image is Completed” and“Abnormality occurs when using R/C” every n seconds.

FIGS. 15A and 15B illustrate a briefing area of a main page according toan example embodiment.

Referring to FIG. 15A, if a briefing area 112-1 of the main page 100-1is selected, a briefing list 112 a-1 is displayed under the briefingarea 112-1. If a briefing close bar 112 b-1 is dragged upwards, thebriefing list 112 a-1 is closed. Even if the briefing list 112 a-1 islong, the briefing list 112 a-1 may be displayed on a front surface ofthe display unit 220 as shown in FIG. 15B. In this case, the briefinglist 112 a-1 may be scrolled up and down.

As shown in FIGS. 15A and 15B, the briefing list provides a menu ofvarious types of notification messages and user selections such as adevice control, a channel notification, an update notification, a jobperformance notification, etc. For example, as shown in FIG. 15B, if anair conditioner operating selection 1501 is input in the briefing list112 a-1, an air conditioner may be controlled to be turned on. If anyselection of the briefing list 112 a-1 is not input for a preset time,the briefing list 112 a-1 may be automatically closed.

FIGS. 16 and 17 illustrate an output of a history screen on a main pageaccording to an example embodiment.

Referring to FIG. 16, if a history button 134-1 of the main page 100-1is selected, the control unit 240 displays a history screen 1610 onwhich a list of use logs of all devices of a home network is arrangedaccording to date. The history screen 1610 may be divided into variousareas such as a display area 1611 displaying a device having a historyof being used on the same day (i.e., today) and a display area 1612displaying a device having a history of being used on another day (e.g.,yesterday).

A user may select an object that the user wants to control on thehistory screen 1610. As shown on 1610 of FIG. 16, if a robot cleanerthat has a history of being used today is selected (1613), the controlunit 240 additionally displays (1620) various menu options 1621 withinthe screen 1610. Here, if an execution menu option 1622 is selected, therobot cleaner may be controlled to be turned on. In this case, the robotcleaner may be executed in an auto mode that is used today (1630).

If the user selects a shortcut menu option 1623 on the history screen1610, a control service page or a detailed function area provided on allservice pages may be displayed for the robot cleaner (1640). Thedetailed function area may provide various menus for controlling acorresponding device. The detailed function area will be described inmore detail later.

If the user selects a delete menu option 1633 on the history screen1610, a corresponding history list is deleted (1650). After deleting, amessage for indicating that the history list is deleted may be displayedat a bottom of the history screen (1660).

A case where the history button 134-1 is selected on the main page 100-1is described with reference to FIG. 17.

Referring to FIG. 17, if an Add to Mode button 1711 is selected on ahistory screen 1710, the control unit 240 displays a screen 1720 forselecting a device that is to be included in a mode that is to be newlygenerated. The user may check a box provided beside a device icon of thescreen 1720 to select a device that is to be included in a mode. If apreset “Going Away” mode is selected (1721), devices that are includedin the mode so as to be controlled are all displayed in a checked state.Here, the user may cancel the check (1722). If a selection of a deviceto be included in a mode to be newly added is selected, the user mayselect a next button 1723. Thereafter, a screen 1730 for inputting aname of the new mode may be displayed, and the user may input a desiredmode name into a mode name input box 1731. Also, the user may select anedit menu provided for each device to change a device state setting whenexecuting a mode. For example, as shown with 1740 of FIG. 17, if theedit menu 1741 for a TV01 is selected (1741), the control unit 240 maydisplay an edit window 1751 in a middle of the display unit 220 (1750).If the user changes and stores settings for the TV01 through the editwindow 1751 (1752), a message indicating that a mode is completely addedmay be displayed at bottom of a screen (1760).

“User mode 01” set as described above may be checked on a mode servicepage that will be described later. In detail, in an environment where anewly generated “User mode 01” is executed, TV01 located in a livingroom is turned on to CH15, an automatic cleaning function of a robotcleaner (R/C) located in the living room is executed, and TV02 locatedin the living room is turned on to CH15. In other words, controls of allthese devices may be simultaneously performed with an execution of “Usermode 01”. A mode service as described above will be described in moredetail later with reference to FIGS. 26 through 34.

The user may be provided with overall information about a home networkthrough the main page 100-1 described above and may execute functionsprovided on each service page without entering each service page. Thefirst service page 100-2 among a plurality of pages connected to themain page 100-1 in a first direction will now be described.

<First Service Page 100-2-Monitoring>

Among a plurality of service pages, the first service page 100-2, whichprovides a monitoring service by using a photographing apparatus of aplurality of devices included in a home network, will now be described.Hereinafter, a first service will be referred to as a monitoringservice.

FIG. 18 illustrates a monitoring service page 100-2 according to anexample embodiment.

Referring to FIG. 18, messages having different contents may be providedat an upper end of a monitoring service summary area 110-2 of themonitoring service page 100-2 according to current monitoring states.For example, information about the number of monitoring cameras that arecurrently operating, positions of the monitoring cameras, a name of aroom where an intruder is sensed, or the like may be displayed inmessage form at the upper end of the monitoring service summary area110-2.

According to an example embodiment, the monitoring service page 100-2may provide an intruder sensing service. Hereinafter, this function willbe referred to as a safety guard service. If a moving object is sensedor an outer forceful intrusion is sensed in the absence of a user, thesafety guard service may provide an automatic recording service througha camera installed at a sensed position. This will be described in moredetail later with reference to FIG. 19.

Also, a lower end of the monitoring service summary area 110-2 includesan area that displays information about a frequently used camera(s).This will be described in more detail later with reference to FIG. 20.

The monitoring service page 100-2 also includes a first function area120-2 of a monitoring service connected to the lower end of themonitoring service summary area 110-2. When the monitoring servicesummary area 110-2 is displayed on the front surface of the display unit220, only a cue area 118-2 of a function area of the monitoring service,which indicates that the function area exists below, is displayed on thedisplay unit 220 as shown in FIG. 19. The first function area 120-2 ofthe monitoring service may be displayed above the monitoring servicesummary area 110-2 according to a user manipulation for dragging the cuearea 118-2 of the function area of the monitoring onto the monitoringservice summary area 110-2. In this case, if other function areas existunder the first function area 120-2 of the monitoring service, the otherfunction areas may be moved upwards together with the first functionarea 120-2 of the monitoring service.

A function area of the monitoring service may provide data captured by adevice included in the home network. For example, a play menu of data,which is captured and stored by a CCTV installed in a room, may beprovided in other function areas of respective rooms, and real-timecaptured data may be provided. In this case, menus for image recordingand screen capturing may be provided in the function area.

Also, the function area may provide a menu for controlling a capturingdirection of the CCTV and a menu for controlling a movement of a devicethat is a moveable device (e.g., a robot cleaner with a camera).

The safety guard function will now be described as an example of aservice provided in a service summary area of a monitoring service inmore detail with reference to FIG. 19.

Referring to FIG. 19, if the user selects a button 134-2 for executingthe safety guard function when the safety guard function is currentlycanceled, a message displayed at an upper end of a monitoring servicesummary area may be changed. For example, as shown with 1920 of FIG. 19,a message for indicating that the safety guard service is operating maybe displayed at the top. If a monitoring camera senses a motion in theabsence of the user, the corresponding camera may perform automaticrecording or automatic capturing, and a captured picture or a recordedvideo may be stored to be displayed at the upper end of the monitoringservice page 100-2 (1940). If the user selects a recorded video or acapture screen 1941 displayed at the upper end of the monitoring servicepage 100-2, the control unit 240 changes a screen into a player screenaccording to a file format thereof (1950).

Referring to 1910 of FIG. 19, the monitoring service page 100-2 mayinclude a frequently used area 140-2 that displays a frequently usedmonitoring camera(s).

Referring to FIG. 20, if a living room screen 141-2 is selected in thefrequently used area 140-2, the living room screen 141-2 may be changedinto a detailed monitoring screen 150-2 of a living room and thendisplayed.

Alternatively, the detailed monitoring screen 150-2 may be immediatelychanged and displayed in a function area. For example, referring to FIG.21, if an enlarge menu icon 3 of the first function area 120-2 of themonitoring service is selected among a plurality of function areas ofthe monitoring service page 100-2, the detailed monitoring screen 150-2may be displayed on the front surface of the display unit 220.

As another example, referring to FIG. 21, if a bookmark menu icon 2 isselected in the first function area 120-2 of the monitoring service, thefirst function area 120-2 of the monitoring service may be registered ina favorite function area of the main page 100-1. In a method asdescribed above, a function area frequently used by the user may beincluded in the main page 100-1, and thus the user may easily look forthe function area frequently used by the user on the main page 100-1without accessing an individual service page.

As another example, if a recording button 120 a-2 is selected in thefirst function area 120-2 of the monitoring service, a recordingfunction may be performed as shown in FIG. 21.

FIG. 22 illustrates another function area of the monitoring service page100-2. Here, a second function area 120-4 of the monitoring service mayprovide a recorded file. If an enlarge menu icon 3 of the secondfunction area 120-4 of the monitoring service is selected, the secondfunction area is enlarged and displayed as a detailed function areadisplaying a list of recorded files arranged in time order. If one ofthe recorded files is selected, a player screen may be displayed in afile form.

Returning to the display of the detailed monitoring screen 150-2,referring to FIG. 23, if a rotation of the user terminal apparatus 200is sensed, the detailed monitoring screen 150-2 may occupy the frontsurface of the display unit 220 to be displayed in a horizontaldirection. If one of a plurality of direction keys 150 a-2, 150 b-2, and150 c-2 is selected on the detailed monitoring screen 150-2, a cameramay be moved in a selected direction.

FIG. 24 illustrates a detailed function of the detailed monitoringscreen 150-2. As shown in FIG. 24, if a power button A is selected, acommand for turning off monitoring is transmitted to a client device, inthis case, to a robot cleaner. If a capture button B is selected, ascreen that is currently monitored is captured, and the captured screenis added into a recorded file list area 152-2 at a bottom. If arecording button C is selected, recording starts. If recording iscompleted, a recorded file is added into the recorded file list area152-2. A scroll bar 152 b-2 provided in the recorded file list area152-2 may be moved to check many more recorded files. If a more button152 a-2 is selected, a detailed recorded file list screen is output.

The detailed recorded file list screen 154-2 will be described withreference to FIG. 25. If a fold button 154 a-2 is selected, an area “IPCam in Living Room” is closed, and recorded files of an area “Porch IPCam 1 in Room 1” may come up to be displayed. If a menu button 154 b-2is selected, refresh, sort by, and delete menu icons may be displayed ina pop-up window. The user may select the sort by menu icon to sortrecorded files according to dates or device names If the delete menuicon is selected, a check box may be generated in an area of a recordedfile icon 154 c-2, and the user may select the check box correspondingto a recorded file to be deleted and then select a complete button (notshown) to delete a file.

Through the user terminal apparatus 200 providing the monitoring servicepage as described above, the user may check a situation of a home evenfrom the outside and check an immediate notification provided to theuser terminal apparatus 200 to effectively cope with an internalintruder.

<Second Service Page 100-3-Mode>Hereinafter, among a plurality ofservice pages, a second service page for differently controlling aplurality of devices included in a home network according to homenetwork modes will be described. Hereinafter, a second service will bereferred to as a mode service.

In the mode service, the user may directly select a plurality of modesand select a mode set by the user to control the plurality of devices ofthe home network. For example, if a particular mode is executed, aplurality of devices associated with the particular mode may besimultaneously turned on. If set values are differently set according todevices when setting a mode, the devices may operate according to theset values when executing the mode. An operation depending on anexecution of a mode will be described in more detail according todetailed example embodiments.

According to an example embodiment, a smart home application stored inthe storage unit 250 may provide a plurality of modes by default, andexamples of default modes may include “Going Away”, “Coming Home”,“Sleep”, “Vacation”, etc. Besides the modes provided by default, theuser may add one or more new modes.

FIG. 26 illustrates a mode service page 100-3 according to an exampleembodiment. Referring to FIG. 26, a mode service summary area 110-3 ofthe mode service page 100-3 may include a scheduled mode area 2601 and afrequently used mode area 2602. If a schedule check button 110 a-3 isselected in the scheduled mode area 2601, the control unit 240 maydisplay a schedule check pop-up on the display unit 220. If a modeexecute button 110 b 3 is selected, the control unit 240 may perform anexecution of a corresponding mode. This will now be described in moredetail with reference to FIG. 27.

The mode service page 100-3 includes a first function area 120-3 of amode service connected to a lower end of a mode service summary area110-3. When the mode service summary area 110-3 is displayed on thefront surface of the display unit 220, only a cue area 118-3 of afunction area of the mode service for indicating that a function areaexists below is displayed on the display unit 220 as shown in FIG. 26.The first function area 120-3 of the mode service is displayed above themode service summary area 110-3 according to a user manipulation fordragging the cue area 118-3 of the function area of the mode serviceinto the mode service summary area 110-3. In this case, if otherfunction areas exist under the first function area 120-3 of the modeservice, the other function areas are also moved upward together withthe first function area 120-3 of the mode service.

FIG. 27 illustrates a UI for executing a mode provided by the userterminal apparatus 200 according to an example embodiment.

Referring to FIG. 27, for example, if the user selects a “Going Away”mode execute button 110 b-3 in the mode service summary area 110-3 ofthe mode service page 100-3, a message for indicating that “Going Away”mode is executed may be displayed at a lower end of the mode servicesummary area 110-3 (2720). In this case, a selected mode is notimmediately executed, and a mode execute cancel button 110 c-3 isdisplayed for a preset time. If the mode execute cancel button 110 c-3is not selected from a preset time N sec, an execution of the selectedmode may be completed, and the corresponding mode may be displayed incolor, i.e., in a different display state from a display state ofanother mode. Therefore, the user may check that the mode is beingexecuted. Also, the mode execute button is displayed in an inactivatedstate (2701).

In detail, if the mode is executed, control states of devices includedin the corresponding mode may be changed into set states. For example,when executing the “Going Away” mode, the user may set the “Going Away”mode to turn off all devices except a refrigerator and a boiler in ahome.

According to an example embodiment, if a device does not operateaccording to a set mode when executing a mode, other devices except thedevice may continuously operate according to the corresponding modewithout stopping a whole part of the mode.

FIGS. 28A and 28B illustrate a UI that is provided by the user terminalapparatus 200 to add a new mode according to an example embodiment.

Referring to FIGS. 28A and 28B, if the user selects a menu button 132-3on the mode service page 100-2, a menu screen 2811 may be displayedunder the menu button 132-3. If the user selects a mode add menu 2812,the control unit 240 may display a window 2821 for receiving a name of anew mode on the display unit 220. If the user inputs a name of a newmode and selects a next button 2822, the control unit 240 changes themenu screen 2811 into a detailed screen 2830 for adding a new mode anddisplays the detailed screen 2830. The detailed screen 2830 is dividedinto two areas, a lower area 2832 is an area that displays a deviceusable in a new mode, and an upper area 2831 is an area that displays aselected device. In this case, an icon corresponding to a deviceselected in the lower area 2832 is displayed in the upper area 2831 andsimultaneously is not displayed in the lower area 2832 anymore. If anicon 2847 of a device is selected in the upper area 2831, the controlunit 240 displays a window 2841 for inputting a set value of the device.The user may input a detailed set value through the window 2841 andstore the detailed set value (2842). If a finish button 2843 isselected, an addition of a new mode is completed (2860).

Hereinafter, a function area of a mode service page will be described inmore detail. The function area of the mode service page may include amode execute menu for executing one mode, and the control unit 240 maysimultaneously control devices included in a group corresponding to themode execute menu.

FIG. 29 illustrates a function area of a service mode page according toan example embodiment. In detail, FIG. 29 illustrates one of a pluralityof function areas respectively corresponding to modes provided on a modeservice page.

Referring to FIG. 29, if a bookmark menu icon 2 is selected in the firstfunction area 120-3 of the mode service, the first function area 120-3of the mode service is registered in a favorite function area of themain page 100-1. In other words, the first function area 120-3 of themode service of the mode service page 100-3 may be looked for on themain page 100-1.

Also, referring to FIG. 29, if an enlarge menu icon 3 is selected in thefirst function area 120-3 of the mode service, the first function area120-3 of the mode service is enlarged as a first detailed function area126-3 of the mode service and then displayed on the front surface of thedisplay unit 220.

Also, whether to execute a set value of a set device may be set in thefirst function area 120-3 of the mode service. For example, referring toFIG. 29, when the “Going Away” mode is executed, a TV is set to beturned off. If the user does not want to turn off the TV, the user maycancel the turning off of the TV.

Also, the user may execute the “Going Away” mode in the first functionarea 120-3 of the mode service. Referring to FIG. 30, if a “ModeExecute” button is selected, the “Mode Execute” button is changed into a“Mode Cancel” button and then displayed for a preset time. If a presettime elapses, the “Going Away” mode is executed. Also, referring to FIG.30, if a reservation button is selected, a schedule reservation screenpops up and then provided in a turn-off state. Here, if turning-off iscanceled, a schedule reservation set value may be input.

FIG. 31 illustrates a UI that is provided by the user terminal apparatus200 to delete a mode according to an example embodiment. Referring toFIG. 31, if the user selects a menu button 132-3 of the first detailedfunction area 126-3 of the mode service, a menu option 3121 is displayedunder the menu button 132-3 (3120). If the user selects a Mode Deletebutton 3122 among these, the control unit 240 displays a window 3131 forinputting a final approval of a mode deletion. Here, if the deleteapprove button 3132 is selected, deleting is completed, and the controlunit 240 displays a mode service summary area 110-3.

Returning to the screen 3120 of FIG. 31, if a mode rename button 3123 isselected, a window for inputting a new name of a corresponding mode maybe displayed. Also, if a reset button 3124 is selected, thecorresponding mode may be reset.

FIG. 32 illustrates a UI that is provided by the user terminal apparatus200 to set a mode reservation according to an example embodiment.Referring to FIG. 32, if a reservation set button 3211 is selected inthe first detailed function area 126-3 of the mode service, the controlunit 240 may display a schedule set screen 3221. Thereafter, the usermay change mode schedule setting through the schedule set screen 3221.For example, the user may set a date, a time, a mode execution repeatedcycle, etc. at which a mode will be automatically executed. If a setstore button 3231 is selected after the user completes setting, amessage for indicating that a schedule is stored may be displayed at alower end of the first detailed function area 126-3 of the mode service(3240). For example, if a mode reservation is turned off as shown with3240 of FIG. 32, the control unit 240 may display “No Schedule” 3241 atan upper end of the first detailed function area 126-3 of the modeservice.

FIG. 33 illustrates a UI for settings of devices included in a mode.Referring to FIG. 33, if the user wants to change a setting of one ofdevices included in a mode, the user may select an icon 3311 of thedevice. In this case, the UI may be an operation of long pressing theicon 3311 of the device. If such a user input is sensed, the controlunit 240 displays an option menu 3321 of a selected device. The optionmenu 3321 may include a device edit menu option 3322 and a device deletemenu option 3323. Here, if the device edit menu option 3322 is selected,an edit screen 3331 may be displayed. The user may change a set value ofthe corresponding device on the edit screen 3331. For example, if aschedule on/off button 3332 is selected to turn off a schedule, an editscreen 3340 may be darkened (e.g., grayed) and displayed. Thereafter, ifa button 3341 is selected, a screen 3350 to which a set value set by theuser is applied is displayed. Referring to 3350 of FIG. 33, a message3351 for indicating that the schedule is turned off may be displayedunder an icon of a corresponding device.

Referring to FIG. 33 again, if a device delete menu option 3323 isselected, a device may be deleted from a corresponding mode.

According to another example embodiment, referring to FIG. 34, if an addbutton 3411 is selected in the first detailed function area 126-3 of themode service, a screen 3420, which includes a plurality of iconscorresponding to a selectable device, is displayed. The screen 3420includes an upper area 3421 that displays an icon of a device includedin a current mode and a lower area 3422 that displays an icon of anaddible device. If the user wants to add a device, the user may selectan icon 3423 of a device to be added. In this case, an iconcorresponding to a selected new device may be replaced and displayed inan area 3431 in which an existing add button is positioned. If the userselects an icon 3432, a screen 3441 for changing a mode set value of adevice corresponding to the icon may be displayed. If a store button3442 is selected after the user completes setting, setting is completed.Thereafter, a message, which is included in the area 3431 displaying thecorresponding icon, is changed into set contents.

Through a mode service page as described above, the user may set aplurality of modes according to tastes of the user and execute only onemode to acquire an effect of executions of a plurality of deviceswithout inputting individual settings of the plurality of devices.

<Third Service Page 100-4-Control>

Hereinafter, among a plurality of service pages, a third service pagethat provides a control menu for respectively controlling operations ofa plurality of devices included in a home network will be described.Hereinafter, a third service will be referred to as a control service.

The control service provides a function of checking a state of a deviceof the home network and a function of turning power on/off.

FIG. 35 illustrates a control service page 100-4 according to an exampleembodiment. Referring to FIG. 35, a control service summary area 110-4of the control service page 100-4 includes a scheduled device area and afrequently used device area. If a schedule check button 110 a-4 isselected in the scheduled device area, a schedule check pop-up iscalled. If a device power button 110 b-4 is selected, a correspondingdevice is turned on or off. This will be described in more detail laterwith reference to FIG. 36.

Also, the control service page 100-4 includes a first function area120-4 of a control service connected under a control service summaryarea 110-4. When the control service summary area 110-4 is displayed onthe front surface of the display unit 220, only a cue area 118-4 of afunction area of the control unit service for indicating that a functionarea exists below is displayed on the display unit 220 as shown in FIG.35. The first function area 120-4 of the control service is displayedabove the control service summary area 110-4 according to a usermanipulation for dragging the cue area 118-4 of the function area of thecontrol service into the control service summary area 110-4. In thiscase, if other function areas exist under the first function area 120-4of the control service, the other function areas are also moved upwardstogether with the first function area 120-4 of the control service.

FIG. 36 illustrates editing of a reserved device that is performed onthe control service page 100-4 provided by the user terminal apparatus200 according to an example embodiment.

Referring to FIG. 36, if a schedule check button 110 a-4 is selected, ascreen 3621 for checking a schedule is displayed. Here, if a resetbutton 3622 is selected, a screen 3631 for setting operation scheduleddate, time, repeated cycle, and the like of a corresponding device isdisplayed. Here, if a reservation cancel button 3623 is selected, areservation of the corresponding device may be canceled. If the userselects a next button 3641 after setting is completed, a screen 3651 forsetting a mode of a device is displayed. For example, if the device is arobot cleaner, an automatic mode for performing automatic cleaning, aspot mode for cleaning a determined spot, a max mode for maximumintensity cleaning, a manual mode for designating a cleaning place, acleaning intensity, etc. by the user, or the like may be provided. If astore button 3652 is selected after a mode is set, a message forindicating that a schedule is stored may be displayed at a lower end ofthe control service summary area 110-4, and a changed setting item maybe displayed in an area 3661 displaying a scheduled device.

The control service page 100-4 provides control UI screens for varioustypes of devices. For example control UI screens for a TV, an airconditioner (A/C), a robot cleaner, a washer, a light, an oven, and aplug will now be described.

A function area of a control service page will now be described in moredetail. The function area of a control service may include a controlmenu for controlling a device included in a home network.

FIG. 37 illustrates a first function area of a control service forcontrolling a TV according to an example embodiment. Hereinafter, forconvenience of description, the first function area 120-4 of the controlservice will be referred to as a TV control card 120-4, and a firstdetailed function area 130-4 of the control service will be referred toas a TV detailed control card 130-4.

Referring to FIG. 37, the TV control card 120-4 includes volume control,power, input (external input), home, and channel control buttons. If anenlarge menu icon 3 is selected, a change into the TV detailed controlcard 130-4 is performed, and the TV detailed control device 130-4includes more many control buttons than the TV control card 130-4. Forexample, if a Navigation tab is selected, a navigation touch pad area orthe like is provided with reference to FIG. 38. If a reservation listtab is selected, a reservation state of turning on and/or off of a TVmay be checked, and a reservation may be added.

FIG. 39 illustrates a second function area of a control service forcontrolling an A/C according to an example embodiment. Hereafter, forconvenience of description, a second function area 121-4 of the controlservice will be referred to as an A/C control card 121-4, and a seconddetailed function area 131-4 of the control service will be referred toas an A/C detailed control card 131-4.

Referring to FIG. 39, the A/C control card 121-4 includes a currenttemperature area, a temperature control button, and a wind directioncontrol button. Here, if a current temperature reaches a maximum orminimum temperature, + or − button may be inactivated. If the enlargemenu icon 3 is selected, a change into the A/C detailed control card131-4 is performed, and the A/C detailed control card 131-4 includesmore many control buttons than the A/C control card 131-4. For example,if an operating tap is selected, an operation mode, such as subtropicalpleasantness, air-conditioning, dehumidifying, cleaning, heating, or thelike, may be selected. If a reservation list tap is selected, areservation state of turning on and/or off an A/C may be checked, and areservation may be added. If Vertical Swing is selected, a winddirection menu changing according to an operation mode may be displayedas shown in FIG. 40.

FIG. 41 illustrates a third function area of a control service forcontrolling a robot cleaner according to an example embodiment.Hereinafter, for convenience of description, a third function area 122-4of the control service will be referred to as a robot cleaner controlcard 122-4, and a third detailed function area 132-4 of the controlservice will be referred to as a robot cleaner detailed control card132-4.

Referring to FIG. 41, the robot cleaner control card 122-4 includesoperation state, power buttons, and the like. If an enlarge menu icon 3is selected, the robot cleaner control card 122-4 is changed to therobot cleaner detailed control card 132-4, and the robot cleanerdetailed control card 132-4 includes more many control buttons than therobot cleaner control card 132-4. For example, if an operate tap isselected, an operation state button, a direction control button, amicrophone, a light, a camera button, etc. are provided. For example, ifthe camera button is selected, an image that is captured through acamera installed in a robot cleaner may be checked.

FIG. 42 illustrates a fourth function area of the control service forcontrolling a washer according to an example embodiment. Hereinafter,for convenience of description, a fourth function area 123-4 of thecontrol service will be referred to as a washer control card 123-4, anda fourth detailed function area 133-4 of the control service will bereferred to as a washer detailed control card 133-4.

Referring to FIG. 42, the washer control card 123-4 includes aninformation screen, a state window, a start button, or the like. If anenlarge menu icon 3 is selected, the washer control card 123-4 ischanged to the washer detailed control card 133-4, and the washerdetailed control card 133-4 includes many more control buttons than thewasher control card 133-4. Also, referring to FIG. 43, if a state window133 a-4 is selected, a menu for changing washing elements, such as awater temperature, rinsing, dewatering, etc. is displayed.

FIG. 44 illustrates a fifth function area of the control service forcontrolling a light according to an example embodiment. Hereinafter, forconvenience of description, a fifth function area 124-4 of the controlservice will be referred to as a light control card 124-4, and a fifthdetailed function area 134-4 of the control service will be referred toas a light detailed control card 134-4.

Referring to FIG. 44, the light control card 124-4 includes aninformation screen, a power button, etc. If an enlarge menu icon 3 isselected, the light control card 124-4 is changed to the light detailedcontrol card 134-4, the light detailed control card 134-4 includes manymore control buttons than the light control card 124-4. If a lightintensity tab is selected in the light detailed control card 134-4, alight intensity may be controlled. If a particular mood is selected, thelight intensity may be automatically controlled according to thecorresponding mood. Referring to FIG. 45, if a Smart Care tab isselected in the light detailed control card 134-4, various care modesare provided. For example, if baby crying is sensed in a Baby Care, adesignated LED may automatically dim. If a motion of the user terminalapparatus 200 is sensed while asleep in a Night Care, a designated LEDmay automatically dim. If there is a missed call in the user terminalapparatus 200 in a Missed Call Care, an LED designated after a presettime may automatically flicker so as to enable the user to check theuser terminal apparatus 200.

FIG. 46 illustrates a sixth function area of the control service forcontrolling an oven according to an example embodiment. Hereinafter, forconvenience of description, a sixth function area 125-4 of the controlservice will be referred to as an oven control card 125-4, and a sixthdetailed function area 135-4 of the control service will be referred toas an oven detailed control card 135-4.

Referring to FIG. 46, the oven control card 125-4 includes aninformation screen, a power button, and the like. If an enlarge menuicon 3 is selected, the oven control card 125-4 is changed to the ovendetailed control card 135-4, and the oven detailed control card 135-4includes many more buttons than the oven control card 135-4. If anoperate tab is selected in the oven detailed control card 135-4, aplurality of oven function buttons, temperature control and select startbutton, etc. are provided.

Referring to FIG. 47, if a particular one is selected from a pluralityof oven functions in the oven detailed control card 135-4, a list 135a-4 that may be provided by the selected function is displayed.

FIG. 48 illustrates a seventh function area of the control service forcontrolling a power plug according to an example embodiment.Hereinafter, for convenience of description, a seventh function area126-4 of the control service will be referred to as a plug control card126-4, and a seventh detailed function area 136-4 of the control servicewill be referred to as a plug detailed control card 136-4.

Referring to FIG. 48, the plug control card 126-4 includes aninformation screen, a power button, and the like. If an enlarge menuicon 3 is selected, the plug control card 126-4 is changed to the plugdetailed control card 136-4, and the plug detailed control card 136-4includes many more control buttons than the plug control card 136-4. Theplug detailed control card 136-4 may provide a reservation list ofon/off reservations.

Through the user terminal apparatus 200 providing a control service pageas described above, the user may easily manipulate devices in a homethrough only the user terminal apparatus 200.

<Fourth Service Page 100-5-Care Report>Among a plurality of servicepages, a fourth service page that provides controls of devices includedin another home network will now be described. Hereinafter, a fourthservice will be referred to as a care report service.

The care report service is a service that checks and reports whether anabnormality occurs in a home registered as a care object, based on adevice use log of the home.

FIG. 49 illustrates a care report service page 100-5 according to anexample embodiment.

Referring to FIG. 49, a care report service summary area 110-5 of thecare report service page 100-5 provides a message having differentcontents according to a current monitoring state and includes a recentlyused device log information area of a home registered as a care object.

If a call button 110 a-5 is selected in the recently used device loginformation area of the home registered as the care object, a call ismade to the corresponding home.

Also, the care report service page 100-5 includes a first function area120-5 of a care report service connected under the care report servicesummary area 110-5. When the care report service summary area 110-5 isdisplayed on the front surface of the display unit 220, only a cue area118-5 of a function area of the care report service for indicating thata function area exists below is displayed on the display unit 220 asshown in FIG. 49. The first function area 120-5 of the care reportservice is displayed above the care report service summary area 110-5according to a user manipulation for dragging the cue area 118-5 of thefunction area of the care report service into the care report servicesummary area 110-5. In this case, if other function areas exist underthe first function area 120-5 of the care report service, the otherfunction areas are moved upwards together with the first function area120-5 of the care report service.

FIG. 50 illustrates a function area that is provided on a care reportservice page according to an example embodiment. In detail, FIG. 50illustrates various states of the first function area 120-5 of the carereport service.

Referring to FIG. 50, for example, if an abnormality occurs in a homeregistered as a care object, and an enlarge menu icon 3 is selected, afirst detailed function area 130-5 of the care report service isdisplayed on the front surface of the display unit 220. Here, if a Callbutton is selected, a call is made to the home registered as the careobject.

Through the user terminal apparatus 200 providing the care service pageas described above, the user may be provided with situation informationabout a home of the user and another home through a user terminalapparatus of the user.

<Fifth Service Page 100-6-Energy>

Among a plurality of service pages, a fifth service page that providesenergy usage information about a plurality of devices included in a homenetwork will now be described. Hereinafter, the fifth service will bereferred to as an energy service.

The energy service provides a service of measuring and managing detailedenergy usage of a device registered in a home network.

FIG. 51 illustrates an energy service page 100-6 according to an exampleembodiment. Referring to FIG. 51, an energy service summary area 110-6of the energy service page 100-6 includes a description message ofenergy, a bar graph 110 b-6 showing energy usage that is currently usedand energy usage goal, and an area indicating information about threedevices having most energy usage among devices registered in a homenetwork.

Also, the energy service page 100-6 includes a first function area 120-6of the energy service connected under the energy service summary area110-6. When the energy service summary area 110-6 is displayed on thefront surface of the display unit 220, only a cue area 118-6 of afunction area of the energy service for indicating that a function areaexists below is displayed on the display unit 220 as shown in FIG. 51.The first function area 120-6 of the energy service is displayed abovethe energy service summary area 110-6 according to a user manipulationfor dragging the cue area 118-6 of the energy service into the energyservice summary area 110-6. In this case, if other function areas existunder the first function area 120-6 of the energy service, the otherfunction areas are also moved upwards together with the first functionarea 120-6 of the energy service.

Referring to FIG. 52, if an edit menu 110 a-6 provided in the energyservice summary area 110-6 is selected, an energy goal value of eachdevice of the home network may be edited.

Also, if the bar graph 110 b-6 provided in the energy service summaryarea 110-6 is selected, a screen, which displays energy usage that iscurrently used and energy usage goal, is output. The user swipes amonthly graph area displayed at a bottom of the screen from side to sideto scroll the monthly graph area. Also, if a detail view button 110 c-6provided in the energy service summary area 110-6 is selected, threedevices having most energy usage among devices registered in the homenetwork are included so as to display energy usage detail information ofother registered devices.

FIGS. 53 through 55 illustrate a function area that is provided on anenergy service page according to various example embodiments. The energyservice page provides a first function area 120-6 (Energy Goal Card) ofthe energy service page, a second function area 122-6 (Monthly EnergyUsage Card) of the energy service page, and a third function area 124-6(Energy Usage Rate Card) of the energy service page.

Referring to FIG. 53, if an enlarge menu icon 3 provided in the firstfunction area 120-6 (Energy Goal Card) of the energy service isselected, a first detailed function area 130-6 of the energy servicepage is displayed as shown in FIG. 53. The first detailed function area130-6 of the energy service page displays an energy goal value set bythe user and information about an amount remaining to the goal value, anexcess of the goal value, or the like.

Also, referring to FIG. 54, if an enlarge menu icon 3 provided in thesecond function area 122-6 (Monthly Energy Usage Card) of the energyservice page is selected, a second detailed function area 132-6 of theenergy service page is displayed as shown in FIG. 54. The seconddetailed function area 132-6 of the energy service page displays amonthly energy usage as a broken line graph in the second detailedfunction area 132-6 of the energy service page and monthly providesdetailed information about power consumption. For example, informationabout a month where energy consumption increases fastest, and a monthlyenergy consumption difference calculation result may also be provided.

Also, referring to FIG. 55, if an enlarge menu icon 3 provided in thethird function area 124-6 (Energy Usage Rate Card) of the energy servicepage is selected, a third detailed function area 134-6 of the energyservice page is displayed as shown in FIG. 55. The third detailedfunction area 134-6 of the energy service page may provide detailedinformation about energy consumption of each device and informationabout monthly energy consumption of each device.

According to the user terminal apparatus 200 providing the energyservice page as described above, the user may check an energy usage atone time and set an energy goal value. Therefore, an energy savingeffect may increase.

<Sixth Service Page 100-7-Media>

A sixth service page that provides a media service by using a mediaoutput device of a plurality of devices included in a home network willnow be described. Hereinafter, a sixth service will be referred to as amedia service. The media service refers to a service through whichrecently played content and recently updated content may be checked andplayed.

FIG. 56 illustrates a media service page 100-7 according to an exampleembodiment. Referring to FIG. 56, a media service summary area 110-7 ofthe media service page 100-7 includes a recently played contentinformation area and a recently updated file information area.

The media service page 100-7 also includes a first function area 120-7of the media service connected under the media service summary area110-7. When the media service summary area 110-7 is displayed on thefront surface of the display unit 220, only a cue area 118-7 of afunction area of the media service for indicating that a function areaexists below is displayed on the display unit 220 as shown in FIG. 56.The first function area 120-7 of the media service is displayed abovethe media service summary area 110-7 according to a user manipulationfor dragging the cue area 118-7 of the function area of the energyservice into the media service summary area 110-7. In this case, ifother function areas exist under the first function area 120-7 of themedia service, the other function areas are also moved upwards togetherwith the first function area 120-7 of the media service.

According to an example embodiment, the user may select a play method ofa content displayed in the media service summary area 110-7. Referringto FIG. 57, if an operation of long pressing a content icon 5711 by theuser is sensed, the control unit 240 may display a playable device list110 a-7. Also, the user may select one of playable devices according toan operation of dragging a movable content icon 5712. With reference to5730 of FIG. 57, a device of the user may be selected as a device forplaying content among the device (My Phone) of the user, a TV in aliving room, a device (Den's) of another user, and a TV in a bedroom.With reference to 5740 of FIG. 57, the user may select the device(Den's) of the other user, not the device of the user. In this case, thedevice of the other user may be a user terminal apparatus of the otheruser registered in the home network. Thereafter, a message 5751indicating that a corresponding content is played in the selected deviceof the other user may be displayed.

A function area of the media service page 100-7 may include a menu formanaging a file stored in at least one of a plurality of devicesincluded in the home network. In detail, FIG. 58 illustrates functionareas that may be provided on the media service page 100-7.

Referring to FIG. 58, a first function area 120-7 of the media service,a second function area 122-7 of the media service, a third function area124-7 of the media service, and a fourth area 126-7 of the media serviceare illustrated. Respective function areas relate to “Movie”, “Music”,“Photo”, and “Recently updated”. If an enlarge menu icon 3 provided ineach function area is selected, a corresponding detailed function areais displayed on the front surface of the display unit 220.

FIG. 59 illustrates a detailed function area provided from a mediaservice. Contents may be arranged and displayed in thumbnail form or inlist form in the detailed function area as shown with 5910 of FIG. 59.If a menu button 5911 is selected to select an option menu, an arrangemenu icon 5921 may be displayed under the menu button 5911. If the userselects the arrange menu icon 5921, a screen 5931 for inputting anarrangement standard may be displayed. Contents may be arranged in orderof date, size, alphabet, or the like. For example, if an alphabeticorder arrangement is selected (5932), contents may be arranged inalphabetic order as shown with 5940 of FIG. 59. The user may re-selectthe menu button 5911 to change the arrangement standard.

According to the media service page as described above, the user mayeasily manage stored contents and play the stored contents by usingother devices connected to the home network.

A plurality of service pages that are provided from a home networkservice will now be described. Hereafter, various types of settingscreens of a home network service will be described.

Referring to FIG. 60, a setting UI screen 400 includes accountmanagement, device management, briefing setting, cleanliness guidesetting, and card management menus.

Here, if an account manage menu 400 a is selected, an account managementUI screen 410 is displayed. As shown in FIG. 61, if a My Profile menuoption 410 a is selected on the account management UI screen 420, ascreen for setting representative photo, name, etc. of my account isoutput. If a family list menu option 410 b is selected on the accountmanagement UI screen 410, a registered family member list 430 isprovided with reference to FIG. 62. The user may set a name, arepresentative photo, etc. of each of registered family members and addor delete a family member as shown in FIG. 62.

FIG. 63 illustrates adding of family members into the registered familymember list 430. Referring to FIG. 63, if a device add menu 6311 isselected on the registered family member list 430, the control unit 240searches for a user located in the same network and displays that theuser is being searched (6320). Thereafter, if a check box provided in alist is selected (6331), and an add button 6341 for completing adding isselected after a family list searched by the user is displayed, aselected member may be added into the registered family member list 430as shown with 6350 of FIG. 63. According to another example embodiment,adding of a family member may be performed through a contact list storedin the storage unit 250 of the user terminal apparatus 200.

Referring to FIG. 60 again, if a device manage menu 400 b is selected, adevice management UI screen 420 is displayed. As shown in FIG. 64, theuser may set names of devices registered in the home network andlocations of the devices on the device management UI screen 420. Also,as shown in FIG. 65, if “device add” is selected in the device managemenu 400 b, a list of searched devices and a list of unsearched devicesare provided in the network. The user may select a device that is to beadded into a provided list.

Also, as shown in FIG. 66, an unsearched device may be added in thenetwork. Referring to FIG. 66, if a device add menu 6611 is selected, ascreen 6630, which provides adding of devices and includes an area 6631displaying a searched device in the network and an area 6632 displayingan unsearched device in the network, may be displayed. The user mayinput Access Point (AP) information, etc. about devices unsearched inthe network to register the devices in the home network system 500(6640).

Referring to FIG. 60 again, if briefing setting 400 c is selected, abriefing setting UI screen 430 is displayed. Referring to FIG. 67,various types of notifications that may be displayed in a briefing area112-1 provided in the information display area 110-1 of the home networkof the main page 100-1 may be set on the briefing setting UI screen 430.For example, if selecting of “automatic temperature control” is canceledon the briefing setting UI screen 430, a notification about atemperature is not displayed in the briefing area 112-1 (refer to FIG.15) of the main page 100-1 anymore.

Referring to FIG. 60 again, if cleanliness guide setting 400 d isselected, a cleanliness guide setting UI screen 440 is displayed.Referring to FIG. 68, the user may set a cleanliness index or seecleanliness guide contents on the cleanliness guide setting UI screen440.

Referring to FIG. 60 again, if a manage card (function area) 400 e isselected, a card management UI screen 440 is displayed. As shown in FIG.69, the user may delete a function area (card) included in a pluralityof service pages 100-2, 100-3, 100-4, 100-5, 100-6, and 100-7 or restorea deleted function area (card) through the card management UI screen440.

A home network management service as described may be provided throughvarious types of UI screens. The home network management service willnow be described with reference to FIGS. 70 through 72.

FIG. 70 illustrates a home network management service that is providedon a lock screen 800 of the user terminal apparatus 200 according to anexample embodiment of the present invention. The lock screen 800 is ascreen that is first displayed when the user terminal apparatus 200 isturned on. A user authentication process may be performed on the lockscreen, and only if an authentication is performed, the user may usevarious functions of the user terminal apparatus 200.

Referring to FIG. 70, the lock screen 800 of the user terminal apparatus200 includes brief information of the home network management service.In other words, the user may be simply provided with importantinformation about the home network without executing a home networkapplication. For example, as shown in FIG. 70, a notification providedfrom a care service or a monitoring service may be provided on the lockscreen 800.

FIG. 71 illustrates a home network management service that is providedon a quick panel of the user terminal apparatus 200 according to anexample embodiment. The quick panel refers to a screen that is displayedby an operation of touching and dragging down one of a plurality ofedges by the user when a basic background screen of the user terminalapparatus 200 is displayed. The quick panel may display brief stateinformation and the like of the user terminal apparatus 200.

Referring to FIG. 71, the quick panel may display at least one offunction areas or main notification information included in theplurality of service pages 100-2, 100-3, 100-4, 100-5, 100-6, and 100-7.

FIG. 72 illustrates a widget of the user terminal apparatus 200according to an example embodiment. The widget is an object for aservice shortcut that is provided on a basic background screen of theuser terminal apparatus 200.

Referring to FIG. 72, a plurality of widgets 820 a, 820 b, 820 c, and820 d are to be connected to a corresponding service page. As shown inFIG. 72, widgets may be selected and registered in option menus providedon the plurality of service pages 100-2, 100-3, 100-4, 100-5, 100-6, and100-7.

As shown in FIG. 73, the present widget may apply layouts of functionareas provided on the plurality of service pages 100-2, 100-3, 100-4,100-5, 100-6, and 100-7.

According to various example embodiments as described above, the usermay use various services provided from a home network service. A methodof managing a home network of a user terminal apparatus according to anexample embodiment will now be described in detail by using a flowchart.

FIG. 74 illustrates a method of managing a home network of a userterminal apparatus according to an example embodiment. Referring to FIG.74, if an application for managing a home network is executed, thecontrol unit 240 displays a first service page of a plurality of servicepages in operation 57410. The plurality of service pages are pages forproviding a plurality of home network management services that may beprovided by using the plurality of devices. Here, the first service pageis a page that is first displayed when executing an application, i.e.,may be a main page or a recently searched service. In detail, if thereis a service page that is used by a user just before, and theapplication is re-executed, the service page that is used just beforemay be displayed.

If a user manipulation in a first direction is input when the firstservice page is displayed, the control unit 240 displays a secondservice page connected to the first service page in operation 57420. Thesecond page is one of a plurality of service pages described above, forexample, a service page that provides a monitoring service of each room,a mode service, a control service of a client device of the homenetwork, etc. An order of arranging a plurality of services may dependon setting of the user, and a service page may be added and deletedaccording to user setting.

If a user manipulation in a second direction is input when the firstservice page or the second service page is displayed, the control unit240 may display a function area included in the first service page orthe second service page in operation 57430.

A service page and a function area as described above have beendescribed in detail in the above-described various example embodiments,and thus their repeated descriptions are omitted.

In a plurality of example embodiments as described above, a UI screenincluding a plurality of services may be selectively displayed accordingto a user manipulation. In this case, map information may be provided soas to enable the user to intuitively check a structure of a whole pageat one time. The map information refers to information that reduces thewhole page, displays the reduced whole page, and indicates a location ofa page that is currently being searched by the user within the wholepage.

FIGS. 75 and 76 illustrate map information that is provided by a userterminal apparatus according to an example embodiment.

According to the present example embodiment, the user terminal apparatus200 may provide location information of a particular area of a servicepage that is currently being searched by the user.

FIG. 75 illustrates a part of the control service page 100-4 that iscurrently being searched by the user within a UI screen including atotal of seven service pages. In detail, the part of the control servicepage 100-4 is displayed on the display unit 220 of the user terminalapparatus 200.

In this state, if a particular user manipulation is input, a structureof a whole UI screen is reduced and then is all displayed within thedisplay unit 220 as shown in FIG. 76. Also, a graphic object 7600 thatinforms the user of a location of an area that is currently beingsearched within the whole UI screen is displayed together. The user mayintuitively know that a current page is a function area (control card 1)of a control service page, with seeing the map information. Thereafter,if the user deletes the map information, the control unit 240 displaysthe function area (control card 1) of the control service page. In thisstate, if the user performs flicking or dragging to the left, thecontrol unit 240 displays a mode service page. If the user performsflicking or dragging to the right, the control unit 240 displays a careservice page.

A user manipulation for displaying the map information may be set by anarbitrary manipulation for calling the map information. For example, ifthe user terminal apparatus 200 rotates in a horizontal direction whenthe user searches for a service page with gripping the user terminalapparatus 200 in a vertical direction, map information displaying alocation of an area that the user is searching for may be displayed asshown in FIG. 75. Alternatively, even if an operation of moving orswinging the user terminal apparatus 200 at a preset speed or the likeis sensed, the map information may be displayed. Alternatively, even ifa menu for moving to the map information is selected when the usersearches for a service page, the map information may be displayed.Whether to display the map information may be selectively performedaccording to an option setting state of the user.

In the above-described example embodiments, an arrangement direction ofa service page is different from an arrangement direction of a functionarea, but the arrangement directions may be variously changed and set.

In detail, according to another example embodiment, a service page maybe configured so as to have a different structure from that shown inFIG. 1. This will be described in detail with reference to FIG. 77.

FIG. 77 illustrates an operation of a user terminal apparatus accordingto another example embodiment. The present example embodiment may beeasily understood in comparison of FIG. 77 with FIG. 11.

In the above-described various example embodiments, function areas ofservice pages (favorite function areas in case of main page) areconnected under service summary areas. According to the present exampleembodiment, function areas are arranged in the same directions as thoseof service summary areas. Therefore, since a function area is equal to apage that is arranged in one direction, the function area will behereinafter referred to as a function area page.

Referring to FIG. 77, for example, if a particular user manipulation isinput when a service summary area 110-3 of a monitoring service page isdisplayed, a first function area page of a monitoring page may begenerated on a side of a service summary area 110-3 and replace theservice summary area 110-3 to be displayed on the display unit 220.Here, if the display unit 220 is realized as a touch screen, theparticular user manipulation may be set to various types ofmanipulations, such as a pinch to zoom (in or out) for simultaneouslydragging two fingers, a double touch, etc. but is not limited thereto.

When a first function area 771 is displayed, a second function area page772 is displayed according to a user manipulation, such as turning overof a page to a side. Only two function area pages are illustrated inFIG. 77, but one function area page or two or more function area pagesmay be included as described with reference to FIG. 1.

If a user manipulation for performing flicking or dragging in adirection where the pages are arranged when the second function areapage 772 is displayed, a summary area 110-6 of an energy service pagemay be displayed.

If a manipulation, such as a pinch to zoom or the like, is input whenthe first function area page 771 or the second function area page 772 isdisplayed, the first function area page 771 or the second function areapage 772 may return to a summary area 110-3 of a monitoring servicepage. In this case, an animation through which the first function areapage 771 or the second function area page 772 disappears or is reducedmay be added.

If a user manipulation, such as flicking or dragging of the summary area119-3 of the monitoring service page to the side, is input when thefirst function area page 771 or the second function area page 772 isclosed, the summary area 110-6 of the energy service page may bedisplayed.

As in the present example embodiment, if a user manipulation of afunction area is input, an operation corresponding to the inputmanipulation may be performed. A detailed example embodiment is equal tothe example embodiments described with reference to FIGS. 1 through 74,and thus repeated descriptions thereof are omitted.

The user terminal apparatus 200 may be realized as various types. In theabove-described example embodiments, the user terminal apparatus 200 isrealized as a smart phone, but may be realized, for example, as a TV.

FIG. 78 illustrates the main page 100-1 if a user terminal apparatus isrealized as a TV. Referring to FIG. 78, the main page 100-1 may bedisplayed on a side of a display unit 900 of the TV. The user may selectvarious menus of the main page 100-1 by using an input unit such aremote control unit.

If a user manipulation for flicking a touch pad of the remote controlunit from side to side is input when the main page 100-1 is displayed, aplurality of service pages may be simultaneously displayed.

If the user terminal apparatus is realized as the TV, a limitation on asize of a display unit is smaller than if the user terminal apparatus isrealized as a smartphone or the like. Therefore, if a full screen changemenu 901 of the main page 100-1 is selected, a plurality of favoritefunction areas 120-1 and 122-1 may be horizontally arranged anddisplayed as shown in FIG. 79. In this case, the user may navigatefavorite function areas from side to side by using a direction key ofthe remote control unit.

Referring to FIG. 79, situation information 902 inside a home may bedisplayed along with the plurality of favorite function areas 120-1 and122-1. Differently from if the user terminal apparatus is realized as asmartphone or the like, if a user manipulation of a category area 903 isinput, a change into a screen displaying a function area of anotherservice may be performed. For example, FIG. 80 illustrates a screen thatdisplays a function area of a monitoring service. Through the categoryarea 903, the user may check whether a currently displayed screen is aservice of which category.

In the previous example embodiment, if a change between service pages ora call of a function area is performed according to a user manipulationin a first or second direction, a similar manipulation may be performedthrough a touch pad provided in a remote control unit in the case of aTV. Alternatively, up, down, left, and right direction keys of theremote control unit may be used.

Even if the user terminal apparatus is realized as the TV, a pluralityof service pages may be displayed as described with reference to FIGS. 1through 73, and as an example, a monitoring service page 100-2 isillustrated in FIG. 81.

Even if a UI for managing a home network is realized as a TV, aprinciple of configuring various types of screens described above withreference to FIGS. 1 through 73 may be applied, and thus more repeateddescriptions are omitted. Changes in some of layouts caused by anincrease in a size of a display unit 900 may be sufficiently understoodthrough FIGS. 78 through 81, and modified example embodiments associatedwith a user manipulation performed through a remote control unit or thelike will be apparent to those skilled in the art.

A user terminal apparatus according to various example embodiments asdescribed above may provide various types of UIs for managing a homenetwork. The various types of UIs may be designed according tocharacteristics of provided services and characteristics of providedinformation. Therefore, a user may easily use a home network servicethrough only a simple operation. In particular, the user terminalapparatus may flexibly change a UI for managing a home network accordingto environment changes in the home network or a manipulation of theuser. Therefore, the user may be provided with an integrated homenetwork management service appropriate for a lifestyle or a taste of theuser.

A method of managing a home network by using various types of UIscreens, which are arranged on a plurality of axes and have differentattributes, has been described in detail in the above-described variousexample embodiments, but the above-described various example embodimentsare not limited to a home network management. For example, a userterminal apparatus that may provide a plurality of services and aplurality of functions may provide UI screens having types as describedabove so as to enable the user to easily select the services and thefunctions. Alternatively, even in various environments for managing aplurality of devices (e.g., a printer, a scanner, a copier, amulti-function peripheral, etc.) connected through a network, a UIscreen may be variously designed to be efficiently managed according tothe above-described method. In other words, contents described in theabove-described various example embodiments may be applied to display aUI screen in a home network system, various types of apparatuses, or asystem.

A method of managing a home network of a user terminal apparatus, amethod of displaying a UI screen, etc. according to the above-describedexample embodiments may be stored on a non-transitory readable medium.The non-transitory readable medium may be mounted and used on varioustypes of apparatuses.

The non-transitory readable medium is readable by devices and includescompact disks (CDs), digital video disks (DVDs), hard disks, Blu-raydisks, universal serial buses (USBs), memory cards, and read-only memory(ROM).

The foregoing example embodiments and advantages are merely illustrativeand should not be construed as limiting. The teachings described hereincan be readily applied to other types of apparatuses. Also, thedescription of the example embodiments is intended to be illustrative,and not to limit the scope of the claims, and many alternatives,modifications, and variations will be apparent to those skilled in theart.

1. A user terminal apparatus comprising: communication circuitryconfigured to be connected to a home network comprising a plurality ofdevices; a display configured to display a UI screen for managing thehome network; a sensor configured to sense user manipulation of the UIscreen; and processing circuitry configured to change the UI screendisplayed on the display according to the user manipulation, wherein theUI screen is one of a plurality of service pages that are changeableaccording to a user manipulation in a first direction, the plurality ofservice pages being pages for respectively providing different homenetwork management services, and at least one of the plurality ofservice pages comprising an area that is displayable on the displayaccording to a user manipulation in a second direction.
 2. The userterminal apparatus of claim 1, wherein in response to one of theplurality of service pages being selected, the processing circuitrydisplays a function area page subordinate to the service page on thedisplay.
 3. The user terminal apparatus of claim 1, wherein the firstdirection corresponds to a horizontal direction, the second directioncorresponds to a vertical direction, and the processing circuitrysequentially displays the plurality of service pages page by page inresponse to a flick or drag manipulation being input in the horizontaldirection and displays a function area comprised in the service page inresponse to a flick or drag manipulation being input in the verticaldirection.
 4. The user terminal apparatus of claim 1, wherein one of theplurality of service pages is a main page, and the main page comprisesan information display area of the home network and at least onefavorite function area that is displayable according to a usermanipulation in the second direction.
 5. The user terminal apparatus ofclaim 1, wherein in response to a new device being added to the homenetwork, the processing circuitry adds one or both of a new service pageand a new function area.
 6. The user terminal apparatus of claim 1,wherein the plurality of service pages comprise at least one of acontrol service page providing a control menu for respectivelycontrolling operations of the plurality of devices, an energy servicepage providing energy usage information of the plurality of devices, amonitoring service page providing a monitoring service by using aphotographing apparatus of the plurality of devices, a media servicepage providing a media service by using a media output device of theplurality of devices, and a mode service page for differentlycontrolling the plurality of devices according to a home network mode.7. The user terminal apparatus of claim 6, wherein a function area ofthe control service page comprises the control menu, a function area ofthe energy service page comprises periodical energy usage information ofthe plurality of devices, a function area of the monitoring service pagecomprises data captured by one of the plurality of devices, a functionarea of the media service comprises a menu for managing a file stored inat least one of the plurality of devices, a function area of the modeservice page comprises a mode execution menu for executing one mode, andin response to the mode execution menu being selected, the processingcircuitry controls devices comprised in a group corresponding to themode execution menu at one time.
 8. The user terminal apparatus of claim1, wherein the plurality of service pages respectively comprise servicesummary areas, wherein in response to a service summary area of oneservice page being displayed and a user manipulation in the seconddirection being performed, the processing circuitry moves and displaysat least one function area connected to the service summary area ontothe service summary area.
 9. The user terminal apparatus of claim 8,wherein in response to the at least one function area being displayed onthe display and an enlarge menu icon of one function area beingselected, the processing circuitry enlarges the one function area to adetailed function area and displays the detailed function area in awhole area of the display.
 10. The user terminal apparatus of claim 8,wherein in response to the at least one function area being displayed onthe display and a pinch gesture being input, the processing circuitryreduces the at least one function area to corresponding objects anddisplays the corresponding objects and, in response to one of theobjects being selected, changes the selected object to a function areaand displays the function area.
 11. The user terminal apparatus of claim4, further comprising: a sensor configured to sense aspects of anorientation of the user terminal apparatus, wherein the processingcircuitry displays the main page according to a first layout in responseto the display being oriented in the vertical direction and displays themain page according to a second layout in response to the display unitbeing oriented in the horizontal direction.
 12. The user terminalapparatus of claim 11, wherein the first layout is a layout in which theinformation display area of the home network and at least one favoritefunction area are connected in the second axis direction based on theinformation display area of the home network, and the second layout is alayout that includes a plurality of state information areas indicatingstate information of respective rooms comprised in an environmentmanaged by the home network.
 13. A method of managing a home network ofa user terminal apparatus, the method comprising: in response to anapplication for managing the home network comprising a plurality ofdevices, being executed, displaying a first service page of a pluralityof service pages for managing the home network; in response to the firstservice page being displayed and a user manipulation in a firstdirection being input, displaying a second service page connected to thefirst service page; and in response to the first service page or thesecond service page being displayed and a user manipulation in a seconddirection, displaying a function area comprised in the first servicepage or the second service page, wherein the plurality of service pagesare pages for respectively providing different home network managementservices.
 14. The method of claim 13, further comprising: in response toone of the plurality of service pages being selected, displaying afunction area subordinate to the service page on a display.
 15. Themethod of claim 13, further comprising: in response to a new devicebeing added to the home network, adding at least one of a new servicepage and a new function area.